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FROM THE EDITOR 


Is Seeing Believing? 


Reality is merely an illusion, 
albeit avery persistent one. —Albert Einstein 


hat we experience shapes our reality. “Seeing is believing,” right? 

Not necessarily. Visual illusions can distort our perception so 

that what we “see” does not correspond with what is physically 

there. This special edition of Scientific American Mind explores 
the world of sensory illusions and delves into how they fool the brain. 

The word “illusion” derives from the Latin illudere, “to mock,” whereas the 
word itself has roots in 14th-century Anglo-French, meaning an act of deception. 
That’s because our brain—not our eyes—is the final arbiter of “truth.” We are 
wired to analyze the constant flood of information from our senses and organize 
that input into a rational interpretation of our world. Much of the time our brain 
decodes those signals correctly. But illusions derail the process—although our 
sensations may seem to be accurate, our perceptions are not. Some illusory 
adaptations help us to survive, such as being able to recognize the same object 
outside in bright sun or in a dimly lit room, despite the difference in brilliance or 
wavelength of the light source. Others just trick us. Illusions are both intriguing 
and fun; our deep fascination with them dates back to the ancient Greeks. For the 
past century, however, they have also played an important role in brain research. 

Illusions help neuroscientists unravel the mysteries of how the human brain 
creates “reality.” In the opening article of this special issue, Susana Martinez- 
Conde and Stephen L. Macknik write, “It is a fact of neuroscience that everything 
we experience is a figment of our imagination.” Understanding how the brain 
“misperceives” sensory input and influences perception is at the heart of their 
research in their respective roles as directors of the Laboratory of Visual Neuro- 
science and of the Laboratory of Behavioral Neurophysiology at the Barrow 
Neurological Institute in Phoenix. In the articles that fill these pages, Martinez- 
Conde and Macknik will show you how your brain constructs 3-D images, how 
context can alter the way you gauge size and perceive color, perspective or pain— 
and share illusions that make objects appear, disappear or move. 

If you want more eye candy, click through the past winners of the Best Illusion 
of the Year Contest. Martinez-Conde and Macknik run the Neural Correlate 
Society, which hosts the annual competition (illusionoftheyear.com). This year’s 
event, sponsored by the Mind Science Foundation and Scientific American, was 
held in May at the Philharmonic Center for the Arts in Naples, Fla. And don’t 
forget to notice the biggest illusion of all: the world around you. 


7“f 
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Issue Editor 
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What 


Means 


You are more than a robot 
searching for 
food and mates 


By Susana Martinez-Conde 
and Stephen L. Macknik 


Is not this whole world an illusion? And yet it fools everybody. 
—Angela Carter, English novelist (1940-1992) 


e are our nervous system. Our brain “drives” 

our body in an evolutionary quest for food 

and mates. If you could remove parts of your 

nervous system one by one, what minimal set 

would need to remain for you to still be you? 
Quadriplegic patients don’t lose consciousness or emotions, despite 
spinal cord damage interrupting the brain signals to their limbs 
and torso. Your spinal column is not critical to who you are. Brain 
damage from stroke or trauma can cause the inability to see, hear 
or smell, but these sensory deficits do not affect our fundamental 
sense of self. 

If you took a neuron, put it ina dish and nourished it (as many 
neuroscientists, including us, have done), you would find that it 
hums along and lives its life just fine as long as the environmental 
conditions remain favorable. It will even form circuits, connecting 
with other neurons you stick in the dish. Drop in some glutamate, 
the most common neurotransmitter in the brain, and the neuron 
will excitedly fire off a volley of impulses. But did it intend to fire? 
Did it consciously decide to express its delight, like a tiny gourmand 
tasting a delicacy by its favorite chef? Or did the neuron act as any 
inanimate machine might, like a heliotropic blade of grass following 
the sun across the sky? 

Let’s put that neuron back in the brainpan, which, by the way, 
is just a dish that will nourish it and keep the conditions favorable. 
That cell will form specific connections and microcircuits that 
somehow result in conscious feeling. Those circuits are now ani- 
mate, just like those underlying the first-person experience of your 
life. How can that be? 

The answer is that we don’t know. Sorry, but this is what re- 
search is about: if we knew the answer, we would be historians 
rather than scientists. What we do know is that everything you have 
ever seen, heard, felt or thought was experienced by neurons in your 
brain, which is a natural miracle in and of itself. Neurons gather 
information from your senses, intellect and memory and so create a 
grand simulation of the world around you, forming the basis of your 
entire consciousness and subjective universe. How neural circuits 
create conscious awareness from insentient neurons is perhaps the 
most important question in science. So how do we answer it? 

When we experience an illusion, our perception fails to match 
the physical reality. This key dissociation makes illusions a power- 
ful tool to isolate the critical brain areas that give rise to our sen- 
tience. It allows scientists like us to discriminate among the neural 
circuits processing information about reality versus our perception 
of that reality. Neuronal responses that correlate to the physical 
reality of an object (such as its physical luminance) and not to our 
perception of it (such as its illusory brightness) cannot be respon- 
sible for our conscious experience. The best way to figure out 
how our brain constructs our experience of the universe is, ironic- 
ally, by studying illusory perception. In this issue are our best 
examples of the twisted, bizarre and truly weird illusions that help 
us understand who we are. 


COURTESY OF GARY ARMSTRONG (bottom) 
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pists 


Neuroscience 


Or 


ILLUSION 


By Susana Martinez-Conde and Stephen L. Macknik 


How tricking the eye reveals the inner workings of the brain 


tis a fact of neuroscience that everything we experience is 

a figment of our imagination. Although our sensations feel 

accurate and truthful, they do not necessarily reproduce the 

physical reality of the outside world. Of course, many ex- 

periences in daily life reflect the physical stimuli that send 
signals to the brain. But the same neural machinery that inter- 
prets inputs from our eyes, ears and other sensory organs is 
also responsible for our dreams, delusions and failings of mem- 
ory. In other words, the real and the imagined share a physical 
source in the brain. So take a lesson from Socrates: “All I know 
is that I know nothing.” 

One of the most important tools used by neuroscientists to 
understand how the brain creates its sense of reality is the vi- 
sual illusion. Historically, artists as well as researchers have 
used illusions to gain insights into the inner workings of the vi- 


sual system. Long before scientists were studying the proper- 


ties of neurons, artists had devised a series of techniques to de- 
ceive the brain into thinking that a flat canvas was three-di- 
mensional or that a series of brushstrokes was indeed a still life. 

Visual illusions are defined by the dissociation between the 
physical reality and the subjective perception of an object or 
event. When we experience a visual illusion, we may see some- 
thing that is not there or fail to see something that is there. Be- 
cause of this disconnect between perception and reality, visual 
illusions demonstrate the ways in which the brain can fail to 
re-create the physical world. By studying these failings, we can 
learn about the computational methods used by the brain to 
construct visual experience. 

Brightness, color, shading, eye movement and other factors 
can have powerful effects on what we “see.” In this series of 
images, we showcase several basic categories of visual illusions 
and what they can teach us about perception in the brain. 


BRIGHTNESS ILLUSIONS 

In this illusion, created by vision scientist Edward H. Adelson of 

the Massachusetts Institute of Technology, squares a and b are 

the same shade of gray. (If you don’t believe it, cut out the two 
squares and place them side by side.) This trick of the eye 
occurs because our brain does not perceive the true colors 
and brightness of objects in the world but instead com- 
pares them with others in their vicinity. For instance, the 
same gray square will look lighter when surrounded by 

black than when it is surrounded by white. 

Another example: when you read printed text on a page 
under indoor lighting, the amount of light reflected by the white 
space on the page is lower than the amount of light that would be 
reflected by the black letters in direct sunlight. Your brain doesn’t 

really care about actual light levels, though, and instead inter- 
prets the letters as black because they remain darker than the 
rest of the page, no matter the lighting conditions. In other words, 
every newspaper is also a visual illusion! 


COURTESY OF EDWARD H. ADELSON M.1.T. 
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Some stationary patterns generate the illusory perception of motion. This unsettling effect is usually stronger if you 
move your eyes around the figure. For instance, in this illusion created by Akiyoshi Kitaoka, a professor of psychology 
at Ritsumeikan University in Japan, the “snakes” appear to rotate. But nothing is really moving other than your eyes! 

If you hold your gaze steady on one of the black dots in the center of each “snake,” the motion will slow down or even 
stop. Because holding the eyes still stops the false sense of motion, eye movements must be required to see it. Vision 
scientists have shown that illusory motion activates brain areas that are similar to those activated by real motion. 
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3-D ILLUSIONS 


This bunch of violets contains the faces of Napoleon Bona- 
parte, Marie Louise of Austria and their son. Can you find them 
among the flowers? Napoleon’s admiring troops gave him the 
name of “Petit Caporal,” or “Little Corporal”: their leader’s short 
stature had not prevented him from defeating four armies 
larger than his own during his very first campaign. Years later, 
when Bonaparte was banished to the isle of Elba, he told his 
friends he would return with the violets, thus earning the nick- 
name of “Corporal Violet, the little flower that returns with 
spring.” When he broke his imposed exile to return to France, 
women supporters assembled to sell violets. They would ask 
passersby, “Do you like violets?” Answering “oui” indicated that 
the person was not a confederate; “eh bien” signaled that the 
respondent adhered to Napoleon’s cause. Napoleon’s support- 
ers distributed reproductions of this 1815 engraving. 

In ambiguous illusions such as this one, the brain interprets 
the same picture in two different ways, with the two interpreta- 
tions being mutually exclusive. You can see one of two possible 
images, but not both at the same time. 

These so-called ambiguous figures are especially powerful 
tools to dissociate the subjective perception from the physical 
world. The physical object never changes, yet our perception 
alternates between two (or more) possible interpretations. For 
this reason, ambiguous illusions are used by many laboratories 
in the search for the neural correlates of consciousness. 


ANDREA JEMOLO Corbis (top); © THE TRUSTEES OF THE BRITISH MUSEUM (bottom) 
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make it appear brighter than 


is another example of how the brain can 
the brown square in the mind’s eye. 


This image, created by R. Beau Lotto of University 
College London with Dale Purves of Duke Univer- 
sity, 
perceive the same color differently when viewed 
in a different context. The central brown square 
on the top of the cube is exactly the same color as 
the central orange square on the side of the cube 
facing the viewer. The latter square looks orange 
because the lighting and surrounding squares 
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erspective 


3-D VISUAL ILLUSIONS 


By Stephen L. Macknik and Susana Martinez-Conde 


What the leaning tower and related illusions reveal about 


ow could we have missed it? Hundreds, perhaps 
thousands, of visual scientists, psychologists, 
neuroscientists, visual artists, architects, engi- 
neers and biologists all missed it—until six years 
ago. The “it” in question is the leaning tower il- 
lusion, discovered by Frederick Kingdom, Ali Yoonessi and 
Elena Gheorghiu, all then at McGill University. In this illu- 
sion, two identical side-by-side images of the same tilted and 
receding object appear to be leaning at two different angles. 
This incredible effect was first noticed in images of the famed 
Leaning Tower of Pisa, but it also works with paired images 
of other receding objects. 

The leaning tower illusion is one of the simplest visual 
tricks one can produce, but it is also one of the most profound 
in relation to our understanding of depth perception. This 
fact is why vision scientists are shaking their heads in disbe- 
lief that they did not notice the illusion earlier. Kingdom and 
his colleagues announced the illusion at the 2007 Best Illu- 
sion of the Year Contest, where it won first prize. 

The annual contest, which we organize and which is host- 
ed by the Neural Correlate Society, celebrates the ingenuity 
and creativity of the world’s premier creators of visual illu- 
sions, both artists and scientists. Contestants submit novel 
visual illusions (that is, unpublished or published no earlier 
than the previous year). An international panel of impartial 
judges conducts the initial review and narrows the dozens of 
submissions down to the 10 best entries. The top 10 creators 
then compete in Naples, Fla., during a gala celebration, in 
which the audience chooses the top three winners. First, sec- 
ond and third prizes take home the coveted “Guido” (a three- 
dimensional illusion sculpture created by renowned Italian 
sculptor Guido Moretti). 


how your brain constructs 3-D images 


TWIN TOWERS? 

In the leaning tower illusion, the tower on the right appears to be 
leaning more than the tower on the left. Yet these two photographs 
of the Leaning Tower of Pisa are duplicates. 

The illusion reveals the way in which the human visual system 
uses perspective to help construct our perception of 3-D objects. 

We Say “construct” because the visual system has no direct access 
to 3-D information about the world. Our perception of depth results 
from neural calculations based on a set of rules. 

These rules include the following: perspective (parallel lines 
appear to converge in the distance); stereopsis (our left and right eyes 
receive horizontally displaced images of the same object, resulting in 
the perception of depth); occlusion (objects near us occlude objects 
farther away); chiaroscuro (the contrast of an object as a function 
of the position of the light source); and sfumato (the feeling of depth 
that one gets from the interplay of in- and out-of-focus elements in 
an image, as well as from the level of transparency of the atmo- 
sphere itself). Because the towers pictured in these paired images 
do not converge as they recede, the brain mistakenly perceives them 
as nonparallel and diverging. 

To learn more about this illusion, go to http://illusionoftheyear. 
com/2007/the-leaning-tower-illusion 


BY F.A.A. KINGDOM, A. YOONESSI AND E. GHEORGHIU, 


IN PERCEPTION, VOL. 36, NO. 3; 2007. REPRINTED WITH PERMISSION FROM PION LTD, LONDON (WWW.ENVPLAN.COM) 


FROM “THE LEANING TOWER ILLUSION: A NEW ILLUSION OF PERSPECTIVE,” 
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THOMAS HALTNER (top); COURTESY OF BRIAN MICKLETHWAIT (middle); 


COURTESY OF AKIYOSHI KITAOKA Ritsumeikan University (bottom) 


The leaning tower illusion 
shows that the brain uses 
the convergence angle 

of two objects as they 
recede into the distance 
to calculate the relative 
angle between them. 
When two parallel towers 
appear in the same 
photograph, such as the 
Petronas Twin Towers in 
Kuala Lumpur, we 
perceive them as parallel 
because they appear to 
converge in the distance 
as they recede. 


Further analysis of similar images reveals subtleties in the way our visual system processes the perception 

of depth and perspective. For instance, the leaning tower illusion also works with paired images of train tracks, 
challenging the classical rules of perspective. It is hard to believe, but these are actually identical images of parallel 
train tracks. Although the angles are the same in both images, the brain perceives them as being quite different. 


The leaning tower illusion does not occur 
when viewing two leaning Japanese 
mané@ga girls, even though the two cartoon 
images are tilted. The reason is that the 
cartoon girls do not appear to recede in 
depth, so our brain does not expect that 
they would converge in the distance. 

This phenomenon demonstrates that the 
brain applies its depth-perception tool kit 
only in specific situations. 
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THINKING INSIDE THE BOX 

The leaning tower illusion is such a fundamental feature of our visual system that 
it works even if one draws a 3-D solid object as it recedes into the distance. 
The parallel lines give the illusion of diverging in the distance. That is, 

the box appears wider at the back than it does at the front, when in fact 
the back and front are precisely the same width on the retina. 


WHAT IS REAL? 

Just as the painter creates the illusion of depth on a flat canvas, our brain creates 

the illusion of depth based on information arriving from our essentially 2-D retinas. 
Visual illusions show us that depth, color, brightness and shape are not absolute terms 
but are subjective, relative experiences actively created by complicated brain circuits. 
This is true not only of visual experiences but of any sensation. Whether we experience 
the feeling of “redness,” the appearance of “squareness,” or emotions such as love 
and hate, these are the results of the electrical activity of neurons in our brain. 

In the movie The Matrix, Morpheus asks Neo: “What is real? How do you define 
real? If you’re talking about what you can feel, what you can smell, what you can taste 
and see, then real is simply electrical signals interpreted by your brain.” What the 
movie doesn’t tell us is that even when Neo awakens from the fake world of the 
“matrix” into the “real world,” his brain will continue to construct his subjective 
experience, as all our brains do, and this experience may or may not match reality. 

So in a way, we all live in the illusory matrix created by our brain. 


COURTESY OF FREDERICK KINGDOM (top); 
WARNER BROS/THE KOBAL COLLECTION 


AT ART RESOURCE, NY (bottom) 
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ANAMORPHIC ART 

Thanks to the brain’s rules 

of perspective, artists can fool 
us into perceiving two- 
dimensional drawings as 
three-dimensional. Artist Kurt 
Wenner’s 3-D pavement 
paintings—such as Muses in 
Lucerne, Switzerland—are 
anamorphic illusions that 
create an impression of three 
dimensions when seen from 
one particular viewpoint 
(above). From the “wrong” 
side, however, you can see the 
distortions that Wenner uses 
to create the 3-D effect (right). 
The word “anamorphic” 
comes from the Greek, 
meaning “formed again.” 


KURT WENNER 
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ALL 


Deceptions 


By Susana Martinez-Conde and Stephen L. Macknik 


Does size matter? To your brain, it doesn’t 


Size matters not. Look at me. Judge me by my size, do you? medium-sized circle will appear smaller when surrounded by 


—Yoda, Jedi master large circles and bigger when surrounded by tiny ones, a phe- 


nomenon discovered by German psychologist Hermann Eb- 


the midget in the country of Brobdingnag and thegi- —_ binghaus. Social and psychological context also causes us to 


ant on the island of Lilliput, Lemuel Gulliver—the protagonist — misperceive size. Recent research shows that spiders appear larg- 


of Jonathan Swift’s Gulliver’s Travels—experienced firsthand er to people who suffer from arachnophobia than to those who 


that size is relative. As we cast a neuroscientific light on thisclas- are unafraid of bugs and that men holding weapons seem taller 


sic book, it seems clear to us that Swift, a satirist, essayist and and stronger than men who are holding tools. In this article, we 


poet, knew a few things about the mind, too. Absolute size is _ present a collection of illusions that will expand your horizons 


meaningless to our brain: we gauge size by context. The same —_ and shrink your confidence in what is real. Try them out for size! 


The full moon rising on 
the horizon appears to 
be massive. Hours later, 
when the moon is high 
overhead, it looks much 
smaller. Yet the disk 
that falls on your retina 
is not smaller for the 
overhead moon than it 
is for the rising moon. 
So why does the over- 
head moon seem 
smaller? One answer 

is that your brain infers 
the larger size of the 
rising moon because 
you see it next to trees, 
hills or other objects on 
the horizon. Your brain 
enlarges the moon to 
fit the context. Look 
for this effect the next 
time you see the moon 
in real life. 


BEAT GLANZMANN Corbis 
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Do you see tiny objects photographed with a macro lens? 

Look again. This remarkable illusion combines tilt-shift 
photography—in which the photographer uses selective focus 
and a special lens or tilted-shot angle to make regular objects 
look toy-size—with the strategic placement of a giant coin. 
Art designers Theo Tveteras and Lars Marcus Vedeler, from the 
Skrekkggle group, created the enormous 50-cent euro coin 
from painted and lacquered wood at a 20:1 scale. 
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BARBIE TRASHES HER DREAMHOUSE 

At first sight, they look like real-life scenes from the television show Hoarders, precleanup. In 
reality, they are photographs of 1:6 scale dioramas by St. Louis—born artist Carrie M. Becker. 

She makes the cardboard boxes, garbage bags and other trash herself. The furniture and tiny ob- 
jects are from Barbie’s Dreamhouse and a Japanese miniatures company called Re-Ment. Becker 
filths up the rooms with actual dirt collected from the filter of a DustBuster, using the occasional 
Re-Ment meatball to simulate dog poop on the floor. When she photographs the scenes without 
an external reference, our brain relies on our everyday experience and assumes that the minuscule 
objects are life-size. Only in proximity to an extraneous, actual-size object does the illusion fail. 


SUPERSIZE ME 

You can look 10 pounds thinner with a well-known slimming 
trick: vertical lines elongate your shape and give you a more 
svelte appearance, right? Wrong! Vision scientists Peter 
Thompson and Kyriaki Mikellidou of the University of York in 
England say instead that it is time to ditch your vertical- 
striped wardrobe and invest in some horizontal-striped 
outfits. They found that vertical stripes on clothing make the 
wearer appear fatter and shorter than horizontal stripes do. 
Notice that the vertical-striped lady seems to have wider 
hips than the horizontal-striped model in the accompanying 
cartoons. The phenomenon is based on the Helmholtz 
illusion, in which a square made up of horizontal lines 
appears to be taller and narrower than an identical square 
made of vertical lines. The original report from 1867 of this 
illusion contained the intriguing reflection that ladies’ frocks 
with horizontal stripes make the figure look taller. Because 
the remark ran counter to contemporary popular belief, the 
York researchers decided to put it to the test, finding that 
19th-century German physicist and physician Hermann von 
Helmholtz did indeed have a great eye for fashion. 
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COURTESY OF CARRIE M. BECKER (top); FROM “APPLYING THE HELMHOLTZ ILLUSION TO FASHION: HORIZONTAL STRIPES 
WON'T MAKE YOU LOOK FATTER,” BY PETER THOMPSON AND KYRIAKI MIKELLIDOU, IN I-PERCEPTION, VOL. 2, NO. 1; 2011. 


USED WITH PERMISSION FROM PION LTD, LONDON (WWW.PION.CO.UK) (b ottom) 
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COURTESY OF JEPPE OLSEN (top); ANTHONY ROSENBERG iStockphoto (bottom) 
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Objects project smaller images on our retinas as they move 
away from us, which can make it hard to decide if an item is 
truly small or just far away (as we see in this photograph). 
Forced perspective photography uses this ambiguity to great 
effect, while eliminating many of the habitual strategies that 
our brain uses to distinguish size from distance, such as stere- 
opsis (our visual system can calculate the depth in a scene 
from the slight differences between our left and right retinal 
images) and motion parallax (as we move, objects closer to us 
move farther across our field of view than distant objects do). 


Is your cuppa joe half empty or half full? 
It depends on your outlook—and on 

a little twist on the Jastrow illusion, 
named after Polish-born American 
psychologist Joseph Jastrow. In this 
classic illusion, two identical arches 
positioned in a certain configuration 
appear to have very different lengths. 
Magician Greg Wilson and writer and 
producer David Gripenwaldt realized 
that Starbucks coffee sleeves have 

the perfect shape for an impromptu 
demonstration of the Jastrow illusion, 
so now you can amaze your office mates 
at your next coffee break. 

All you need to do is align the coffee 
sleeves as in the accompanying photo- 
graph and—presto!—your tall cup sleeve 
is now venti-size! Your brain compares 
the upper arch’s lower right corner with 
the lower arch’s upper right corner and 
concludes, incorrectly, that the upper 
sleeve is shorter than the lower sleeve. 
(We would like to thank magician 
Victoria Skye for her demonstration 
of the Jastrow illusion with Starbucks 
coffee sleeves.) 


(Further Reading) 


@ Sleights of Mind: What the Neuro- 
science of Magic Reveals about Our 
Everyday Deceptions. Stephen L. 
Macknik and Susana Martinez-Conde, 
with Sandra Blakeslee. Henry Holt, 2010. 

@ Applying the Helmholtz Illusion to 
Fashion: Horizontal Stripes Won’t 
Make You Look Fatter. Peter Thompson 
and Kyriaki Mikellidou in i-Perception, 
Vol. 2, No. 1, pages 69-76; 2011. 

@ It Was as Big as My Head, | Swear!: 
Biased Spider Size Estimation in Spider 
Phobia. M. W. Vasey, M. R. Vilensky, 

J. H. Heath, C. N. Harbaugh, A. G. Buffing- 
ton and R. H. Fazio in Journal of Anxiety 
Disorders, Vol. 26, No. 1, pages 20-24; 
January 2012. 

@ Weapons Make the Man (Larger): 
Formidability Is Represented as Size 
and Strength in Humans. D.M.T. Fessler, 
C. Holbrook and J. K. Snyder in PLOS ONE, 
Vol. 7, No. 4, Article e32751; 2012. 
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Faithful 


RESEMBLANCE 


By Susana Martinez-Conde and Stephen L. Macknik 


When seeing is believing 


There are things in that [wall]paper that nobody knows 
but me, or ever will. Behind that outside pattern the dim 
shapes get clearer every day. It is always the same shape, 
only very numerous. And it is like a woman stooping 
down and creeping about behind that pattern. 
—Charlotte Perkins Gilman, 
“The Yellow Wallpaper,” 1892 


THE PROTAGONIST in Charlotte Perkins Gilman’s short story 
“The Yellow Wallpaper” suffers from the most notable case of 
pareidolia in fiction. Pareidolia, the misperception of an acciden- 
tal or vague stimulus as distinct and meaningful, explains many 
supposedly paranormal and mystical phenomena, including 
UFO and Bigfoot sightings and other visions. In Gilman’s story, 
the heroine, secluded in her hideously wallpapered bedroom and 
having nothing with which to occupy herself, is driven to insan- 
ity—full-blown paranoid schizophrenia—by the woman behind 


a 


BANK OF CANADA - BANQUE 


TWENTY 


GOD SAVE THE QUEEN 
Canadian banknotes issued in 1954 featured a portrait of British 
monarch Elizabeth II. The young queen looked majestic and 
serene, despite the grinning demon tucked in the curls behind 
her regal ear (colored red, to make it easier to see). Talk about 
having a royally bad hair day! Canadians were understandably 
appalled by what became known as the “Devil’s head” or “Devil’s 
face” series. In 1956 the Bank of Canada ordered banknote 
companies to darken the highlights in the queen’s hair, effec- 
tively exorcising the King of Hell from Canadian currency. 


the yellow pattern. As she descends into madness, she comes to 
believe that she is imprisoned by the wallpaper. 

Mental disease can aggravate pareidolia, as can fatigue and 
sleepiness. After a recent surgery, one of us (Martinez-Conde) 
noticed faces everywhere, in places as unlikely as the ultra- 
sound images of her left arm during an examination of poten- 
tial postsurgical blood clots. She realized at once that the ubiq- 
uitous faces were the product of lack of sleep and the high titer 
of pain medication in her bloodstream, so she was more fasci- 
nated than concerned. Her doctor agreed but made a note in 
her file for a different drug regime in the future. Just in case. 
Luckily, the hospital room’s walls were bare, and there was no 
yellow wallpaper in sight. Our brain is wired to find meaning. 
Our aptitude to identify structure and order around us, com- 
bined with our superior talent for face detection, can lead to 
spectacular cases of pareidolia, with significant effects in soci- 


ety and in culture. 


COURTESY OF NATIONAL CURRENCY COLLECTION/CURRENCY MUSEUM/BANK OF CANADA, OTTAWA 
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THE FACE FROM SPACE 

In 1976, as NASA’s Viking 1 circled Mars looking for possible 
landing sites for its sister ship Viking 2, it spotted the likeness 

of a mile-wide human (or maybe Martian?) face, staring back from 
the Red Planet’s region of Cydonia. Scientists believed that the 
Martian “sphinx” was one of numerous mesas around Cydonia 
and that unusual shadows made it look like a humongous head. 
Conspiracy theorists favored the alternative explanation of a 
government cover-up, however, and criticized NASA’s unsuccessful 


Mind.ScientificAmerican.com 


attempts to hide the remnants of an ancient Martian civilization. 
Some two decades later, obtaining high-resolution images of 
Cydonia became a priority for NASA. “We felt this was important to 
taxpayers,” said Jim Garvin, then chief scientist for NASA’s Mars 
Exploration Program. “We photographed the Face as soon as we 
could get a good shot at it.” In April 1998 the Mars Orbiter Camera 
team snapped a picture 10 times sharper than the original Viking 
photos, revealing the mystifying Face on Mars to be ... a mesa. 
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EYE OF THE TIGER 

Neurologists Péricles Maranhao-Filho and 
Maurice B. Vincent of the Federal University 
of Rio de Janeiro advocate the use of face- 
detection illusions as heuristics to help 
doctors diagnose neurological diseases. 
One is PKAN, or pantothenate kinase- 
associated neurodegenerative disease, 
which results from mutations in the genes 
encoding the enzyme responsible for the 
biosynthesis of coenzyme A. Typically PKAN 
starts during childhood, and most patients 
lose the ability to walk within 15 years. The 
brains of PKAN patients show decreased 
intensity of the globus pallidus (involved in 
motor control) from iron accumulation, with 
a central area of increased intensity from 
necrosis. The image looks decidedly feline, 
providing the so-called eye-of-the-tiger sign. 


SATAN IN THE SMOKE 

Photojournalist Mark D. Phillips 
captured the World Trade Center, 
engulfed in smoke and flames, seconds 
after the second plane attack on 9/11. 
Unknown to Phillips at the time, the 
picture, distributed by Associated 
Press and published on the front pages 
of several newspapers, contained the 
face of none other than the Prince of 
Darkness. A media frenzy ensued, and 
Phillips, who retired from photojourn- 
alism that same day, received more 
than 30,000 messages related to 

the “face of evil” in the murky cloud 
and the feelings it brought forth in 

the viewers. 

One year later computer scientists 
Vladik Kreinovich and Dima lourinski, 
both then at the University of Texas at El 
Paso, published a geometric analysis of 
the face in the photograph, also seen in 
a different image from CNN. The analysis 
showed that perturbations in the smoke 
can consist of horizontal lines (such as 
the “eyes” and “mouth”) and vertical 
lines (such as the “nose”) overlaid on 
aconic surface (the “head”). The sci- 
entists concluded that both the back- 
ground shape (the cone) and the fea- 
tures on the background (horizontal and 
vertical lines) are naturally explained by 
the physics and geometry of smoke 
plumes emanating from fire. 


FROM “THE EYE-OF-THE-TIGER SIGN,” BY R. PAUL GUILLERMAN, IN RADIOLOGY, VOL. 217; DECEMBER 2000. USED WITH PERMISSION 
FROM RADIOLOGICAL SOCIETY OF NORTH AMERICA (top left); ANDY GEHRIG iStockphoto (top right); MARK D. PHILLIPS markdphillips.com (bottom) 
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SEPTEMBER 2011. REPRINTED WITH PERMISSION FROM ELSEVIER (top); COURTESY OF JONATHAN B. BOREYKO AND CHUAN-HUA CHEN Duke University (middle); 


FROM “THE FACE OF TESTICULAR PAIN: A SURPRISING ULTRASOUND FINDING,” BY G. GREGORY ROBERTS AND NAJI J. TOUMA, IN UROLOGY, VOL. 78, NO. 3; 
© SALVADOR DALI, FUNDACIO GALA-SALVADOR DALI, ARTISTS RIGHTS SOCIETY, NEW YORK, 2013 (bottom) 


Medical imaging is a new fertile ground for 
pareidolia. Urologists G. Gregory Roberts 
and Naji J. Touma of Queen’s University in 
Ontario were shocked to discover a face, 
contorted in agony, in the scrotal ultra- 
sound images (top) of a 45-year-old man 
afflicted with severe testicular pain. The 
doctors toyed with the idea that the image 
might be a manifestation of Min, the Egyp- 
tian god of male virility, but ultimately 
deemed the facial features in the benign 
mass accidental. 

Physics World reporter James Dacey 
was similarly startled to discover the 
face of Beatle Ringo Starr in a series of 
high-speed images of waterdrops bounc- 
ing on the surface of a lotus leaf, cap- 
tured by a team of researchers at Duke 
University (middle). 

The brain’s capacity to establish false 
links among things that are not actually 
connected is essential to the “paranoiac- 
critical method” artistic technique 
invented by Spanish surrealistic painter 
Salvador Dali. (Paranoia and pareidolia 
have the same etymology, from the Greek 
para- for “instead of” and -oid, -oeides or 
-eidos for “form.”) In Dali’s Slave Market 
with the Disappearing Bust of Voltaire, 
several features in Voltaire’s face are 
formed by the bodies of people in the 
scene (bottom). 

Dartmouth College neuroscientist 
Ming Meng and his colleagues have imaged 
the brains of observers while they viewed 
faces and objects that looked like faces. 
The left fusiform gyrus was activated by 
both faces and objects resembling them, 
whereas the right fusiform gyrus showed 
much stronger activation to actual faces 
than to look-alikes. 


(Further Reading) 


@ Unmasking the Face on Mars. NASA Science; May 24, 
2001: http://science1.nasa.gov/science-news/science- 
at-nasa/2001/ast24may_1 

@ Was There Satan’s Face in the World Trade Center Fire? 
A Geometric Analysis. V. Kreinovich and D. lourinski 
in Geombinatorics, Vol. 12, No. 2, pages 69-75; 2003. 

@ Neuropareidolia: Diagnostic Clues Apropos of Visual 
Illusions. P. Maranhao-Filho and M. B. Vincent in Arquivos 
de Neuro-Psiquiatria, Vol. 67, No. 4, pages 1117-1123; 
December 2009. 

@ The Face of Testicular Pain: A Surprising Ultrasound 
Finding. G. Gregory Roberts and Naji J. Touma in Urology, 
Vol. 78, No. 3, page 565; September 2011. 

@ Satan in the Smoke? A Photojournalist’s 9/11 Story. 
Mark D. Phillips. South Brooklyn Internet, 2011. 

@ Lateralization of Face Processing in the Human Brain. 
Ming Meng, Tharian Cherian, Gaurav Singal and Pawan 
Sinha in Proceedings of the Royal Society B. Published 
online January 4, 2012. 
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Your Twisted 


By Stephen L. Macknik and Susana Martinez-Conde 


Illusions that distort your perception 


begins with our retinas locating the edges of objects in the world. Downstream neural 
mechanisms analyze those borders and use that information to fill in the insides of objects, 
constructing our perception of surfaces. What happens when those borders—the fundamental 
fabric of our visual reality—are tweaked? Our internal representation of objects fails, 
and our brain’s ability to accurately represent reality no longer functions. 
Seemingly small mistakes lead to the very distorted perceptions of an illusory world. 


The upper left pair of nested circular twisted cords 
shows how a subtle local effect can have major glob- 
al consequences on our perception of shapes, even 
one as deceivingly simple as a circle. (To convince 
yourself that these circles do not actually have cor- 
ners, see the video at www.youtube.com/watch?v=a 
XndBsOdvdg&feature=plcp.) The twist in the cords 
even works when the twisted elements are not 
touching, as in the spectacular Intertwining Illusion 
by vision scientist Baingio Pinna of the University of 
Sassari in Italy (top right). Because the interacting 
visual elements are not in contact with one another, 
Pinna’s version is strongest when you see it with your 
peripheral vision— out of the corner of your eye. Visu- 
al neurons processing peripheral information have low 
spatial resolution, allowing them to “see” the gross 
details of objects only, so even distant tilted squares 
produce the perception of a twisted cord. The low res- 
olution of peripheral visual neurons also plays a role 
in the bizarre It’s a Circle, Honest! illusion by vision sci- 
entist David Whitaker of the University of Bradford in 
England and a top-10 finalist in the 2007 Best Illusion 
of the Year Contest (http://illusionoftheyear.com). 
On the lower left, the circle looks round only 
if you look directly at it; if you position it in the 
corner of your eye, it has corners! The smaller 
elements making up the lower right circle smear 
out to gray in the visual periphery, making the 
circle look more rounded. 


University of Sassari (top row, right); COURTESY OF DAVID WHITAKER University of Bradford (bottom row) 


COURTESY OF AKIYOSHI KITAOKA Ritsumeikan University (top row, left); COURTESY OF BAINGIO PINNA 
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PLUMB CRAZY 
No, the architects of this building were not drunk at the drawing board. In fact, the 
structure is perfectly rectilinear in every way. No slants, no tilts and no curves: just 
good old traditional 90-degree angles at work here. The Australian architectural firm 
of Ashton, Raggatt, and McDougall based the facade design at the Port 1010 building 
in Melbourne on a famous bit of visual trickery known as the café wall illusion, popular- 
ized by the late vision scientist Richard Gregory of the University of Bristol in England. 
Mark McCourt, a vision scientist at North Dakota State University, has shown that the 
positions of the black-and-white bricks invoke a reverse contrast effect called bright- 
ness induction, which results in the mortar having the appearance of a twisted cord. 
Vision scientist and illusion creator Akiyoshi Kitaoka of Ritsumeikan University in 
Japan has further demonstrated this effect in minimalist fashion by isolating it to 
a single row of mortar with blocks. The alternation of black-and-white brick positions 
results in an alternating direction in the twisted cords of the mortar. The brain inter- 
prets these cords as being slightly tilted depending on the direction of the twist. 


PETER BENNETTS (top); SCIENTIFIC AMERICAN MIND (bottom) 
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BUILDING THE IMPOSSIBLE, ONE LEGO AT A TIME 
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PASCAL LE SEGRETAIN Getty Images (left); SCIENTIFIC AMERICAN MIND (right) 


Women’s makeup enhances the attractive facial features 
while hiding the undesirable. Now there is an outfit to 
accomplish the same illusory feat for your body. Actor Kate 
Winslet’s dress, created by British fashion designer Stella 
McCartney, uses contrasting shapes to accentuate hips, 
shoulders and otherwise highlight the female form. For 
maximum effectiveness, be sure to wear it only in front 

of a black background. 


N 


N 


Spatial distortions can be measured for their power to alter percep- 
tion. The seesaw at the top seems to tilt to the right, although, in 
fact, it is not tilting at all. If we remove the twisting candy-cane 
stripes from within, we now see the veridical planks and their untilt- 
ed truth. A clever variant of this illusion, with a physically tilted plank 
that appears level through illusory means, reveals that the illusion is 
equivalent, perceptually, to as much as a four-degree actual tilt. 

A nice animated version of the effect is at www.moillusions.com/ 
2009/02/slanted-seesaw-optical-illusion.html 


(Further Reading) 


@ Brightness Induction and the Café Wall Illusion. M. E. McCourt in Perception, Vol. 12, 
No. 2, pages 131-142; 1983. 

@ Shifts of Edges and Deformations of Patterns. B. Pinna and R. L. Gregory in Perception, 
Vol. 31, No. 12, pages 1503-1508; 2002. 
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Vanished 


WITHOUT A 
TRACE 


By Susana Martinez-Conde and Stephen L. Macknik 


Fading illusions play hide-and-seek with your perception 


I don’t think there is anything wrong with white 
space. I don’t think it’s a problem to have a 
blank wall. 


—Annie Leibovitz 


ACCORDING TO a legend that one of us (Martinez- 
Conde) heard growing up in Spain, anybody can see the 


Devil’s face. All you need to do is to stare at your own 
face in the mirror at the stroke of midnight, call the Dev- 
il’s name and the Prince of Darkness will look back at 
you. Needless to say, I was both fascinated and terrified 
by the possibility. And I knew this was an experiment I 
must try. I waited a day or two to gather my courage, 
then stayed awake until midnight, got up from my bed, 


VANISHING ACT 
Camouflage and the perceptual effect known as Troxler fading combine to make a leopard nearly invisible. Look around the 
image. Hint: The leopard’s head is hiding in the tall grass near the lower right corner. Once you find it, hold your gaze on the 
tree trunk while paying attention to the animal’s location. He’s gone! Look straight at the leopard to revive your perception. 


ART WOLFE/WWW.ARTWOLFE.COM 
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COURTESY OF AKIYOSHI KITAOKA Ritsumeikan University (top); ERICH LESSING/ART RESOURCE, NY (bottom) 


and into the bathroom I went. I closed the door behind me 
so that my family would not hear me calling out loud for Sa- 
tan, faced my wide-eyed reflection, made my invocation, and 
then ... nothing happened. I was disenchanted (literally) but 


with a face that seemed suddenly unfamiliar. Some felt power- 
ful emotions. 

After reading Caputo’s article, I had to give “Satan” anoth- 
er try. I suspected that my failure to see anything other than my 


also quite relieved. 

Now, three decades later, a paper 
entitled “Strange-Face-in-the-Mirror 
Illusion,” by vision scientist Giovanni 
B. Caputo of the University of Urbino 
in Italy, may explain my lack of results. 
Caputo asked 50 subjects to gaze at 
their reflected faces in a mirror for a 
10-minute session. After less than a 
minute, most observers began to per- 
ceive the “strange-face illusion.” The 
participants’ descriptions included 
huge deformations of their own faces; 
seeing the faces of alive or deceased 
parents; archetypal faces such as an old 
woman, child or the portrait 
of an ancestor; animal faces 
such as a cat, pig or lion; and 
even fantastical and mon- 
strous beings. All 50 partici- 
pants reported feelings of 
“otherness” when confronted 
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This pattern, generated by vision scientist Akiyoshi Kitaoka of 
Ritsumeikan University in Japan, contains a yellow dot at the 
center of each set of four blue “petals.” That makes a total of 
61 yellow dots! To prove it to yourself, examine each “flower” 
in turn and see that all of them contain a central yellow spot. 
The problem is that you can see only one spot at a time. The 
others disappear when you are not looking at them directly. 


petrified self in the mirror 30 years ago 
had to do with suboptimal lighting con- 
ditions for the strange-face illusion to 
take place. Caputo recommended dim 
lighting, so that observers might see their 
facial features in detail but experience at- 
tenuated color perception. So this time I 
turned off the bathroom lights and 
turned on my cell phone’s flashlight, then 
placed it on the floor behind me, so that 
I could not see its reflection on the mir- 
ror. Then I looked at myself and waited. 

My efforts were rewarded quickly. 
Portions of my face started to disappear, 
contract or expand, and suddenly all the 
features would come back, giv- 
ing mea bit of a start. I was par- 
ticularly thrilled to experience 
some of the dissociative identi- 
ty effect that the experimental 
participants reported, feeling 
as if the face staring back at me 


Impression, Sunrise, by French painter Claude Monet in 1872, 
gave its name to the Impressionist movement. The subject of the 
painting is the harbor of Le Havre in France, as seen from Monet’s 
window. It was not, however, Monet’s actual view of the scene, as 
he later explained, but his “impression”—hence the title. Indeed, 
Sunrise does not accurately represent reality: the rising sun ap- 
pears much brighter than the surrounding sky, as it should in real 
life, but that perception is an illusion. Monet used pigments of 
matching luminance, or brightness, but different chromatic con- 
tent, or hues, to represent the sun and the sky. Harvard University 
neurobiologist Margaret S. Livingstone has proposed that this 


equiluminant quality, where objects in the image have the same 
luminance as the background, is what gives the sun its eerie, al- 
most pulsating, lifelike appearance. A black-and-white reproduc- 
tion reveals that the sun has the same physical luminance as the 
background clouds. 

Equiluminant objects are somewhat difficult to see, which 
makes them more susceptible to Troxler fading. Neuro-ophthal- 
mologists Avinoam B. Safran and Theodor Landis, both then at 
University Hospitals of Geneva, noticed that if you fix your gaze on 
the image of the sailor in Monet’s painting for several seconds, 
while paying attention to the sun, the solar disk will disappear 
progressively, being replaced by the surrounding sky. 
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HEALING GRID 

This illusion, created by cognitive neuroscientist Ryota 
Kanai, then at Utrecht University in the Netherlands, was a 
top-10 finalist in the 2005 Best Illusion of the Year Contest 
(http://illusionoftheyear.com). Explore the image freely, 
and you will see a regular pattern of intersecting horizontal 
and vertical lines in the center, surrounded by an irregular 
grid of misaligned crosses. Choose one of the intersections 
on the center of the image and stare at it for 30 seconds or 
so. You will see that the grid “heals” itself, becoming per- 
fectly regular all the way through. The illusion results from 
both perceptual fading and the ensuing neural guessti- 
mates that our brain imposes to “fill in” the outer parts of 
the image based on the available information from the cen- 
ter, in addition to our nervous system’s intrinsic tendency 
to seek structure and order, even when the sensory input 


LURKING LADYBUGS 

In the left image of the pair that makes 
up this illusion, also by Kitaoka, each of 
the four squares in the corners has three 
ladybugs. The little insects are easy to 
see as you look around the image, but 
when you stare at the center of the pat- 
tern they vanish immediately. The right- 
hand image shows they do not become 
invisible by virtue of their small size: in 
the absence of the squares, all 12 lady- 
bugs are perceptually prominent, no 
matter where in the image you look. 


is fundamentally disorganized. 


was both mine and yet not mine. Disappointingly, I did not see 
any monstrous creatures or ghosts of ancestors calling me from 
the beyond (or even Satan, for that matter), but I think I came 
close to seeing one of the “archetypal” faces. Weirdly, halfway 
through the experiment, my face appeared to morph into a se- 
pia portrait of an old Native American warrior. But as soon as 
it arrived, it was gone. 


Fade to Gray 

Why does this happen? To explain, we need to start with 
Erasmus Darwin, the English natural philosopher and physician 
and grandfather of Charles Darwin. In the late 18th century he 
described how objects can fade after steady gazing: “On looking 
long on an area of scarlet silk of about an inch in diameter laid 
on white paper ... the scarlet color becomes fainter, till at length 
it entirely vanishes, though the eye is kept uniformly and steadily 
upon it.” Swiss philosopher Ignaz Paul Vital Troxler later cor- 
roborated Darwin’s observations, using colored patches on a 
wall. The phenomenon became known as Troxler fading. 


Neural adaptation, the mechanism by which neurons de- 
crease or stop their response to unchanging stimulation, is 
thought to underlie perceptual fading during prolonged gazing 
at an object or scene. Once the target of interest has vanished, 
blinks, gaze shifts and even microscopic involuntary eye move- 
ments called microsaccades can restore it to perception instant- 
ly [see “Shifting Focus,” by Susana Martinez-Conde and Ste- 
phen L. Macknik; ScIENTIFIC AMERICAN MIND, November/ 
December 2011]. 

Troxler fading and neural adaptation may partly explain Ca- 
puto’s strange-face illusion. When we gaze long and steady into 
our reflected face, the unchanging nature of the visual stimulus 
causes facial features to disappear (and then reappear, as we 
blink or make involuntary eye movements, thereby “refreshing” 
our neuronal responses). In the absence of visual information, 
our brain will “fill in” the gaps according to our experiences, 
expectations, best guesses, and even hardwired neural mecha- 
nisms involved in shape and face perception. The result can be 
amusing or disquieting. 


COURTESY OF RYOTA KANAI Utrecht University (bottom) 


COURTESY OF AKIYOSHI KITAOKA (top); 
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© 2013 ESTATE OF PABLO PICASSO/ARTISTS RIGHTS SOCIETY, NY, AND © MUSEUM OF MODERN ART/LICENSED BY SCALA/ 


ART RESOURCE, NY (top); COURTESY OF DANIEL SIMONS University of Illinois at Urbana-Champaign (bottom) 


A few years ago I had the opportunity to collaborate with cognitive scien- 
tist Daniel Simons (author, with Christopher Chabris, of The Invisible Go- 
rilla, Random House, 2010) and his colleagues at the University of Illinois 


at Urbana-Champaign on an experiment to investigate visual fading in entire 


scenes. You can experience the effect by focusing your gaze precisely at the cen- 


THERE GOES THE NEIGHBORHOOD 

Stare at the center of this scene for several 
seconds to make it fade. Then move your 
eyes freely to revive it. 


ter of the blurry image 
while paying attention to 
the entire scene. Careful 
staring for just a few sec- 
onds will minimize your 
eye movements, causing 
the scene to fade to gray. 
Now stop focusing your 
gaze, and the scene will 
come right back. Scien- 
tists are able to make non- 
blurred scenes fade in the 
laboratory by completely 
removing or by compen- 
sating for the observer’s 
eye movements. 


BEAUTY IN THE EYE OF THE BEHOLDER 

Artwork may contain “errors” that are obvious to our 
central vision but become invisible when viewed from 
the corner of our eye. Neuroscientist Denis Pelli of 
New York University discovered that Pablo Picasso’s 
Maquette for Guitar (1912) appears absurd only when 
we look at it directly: the strings are torn and twisted, 
the neck is crooked, and the body is split into discon- 
nected pieces. But now focus on the cross above 
while still paying attention to the guitar: all you can 
see are the smooth curves and elegant angles of a 
beautiful instrument. Pelli hypothesizes that the illu- 
sion works because our peripheral vision confuses the 
locations of the parts. Failure to notice the errors in 
the maquette produces the perception of a real gui- 
tar. Picasso’s paintings of Nusch Eluard, a French 
acrobat, show a similar phenomenon. When viewed 
directly, the portraits are grotesque, but when seen 
peripherally, the young woman looks exquisite. Pelli 
suspects that Picasso was well aware of this effect. 


(Further Reading) 


@ The Vanishing of the Sun: A Manifestation of Corti- 


cal Plasticity. Avinoam B. Safran and Theodor 
Landis in Survey of Ophthalmology, Vol. 42, No. 5, 
pages 449-452; March-April 1998. 


@ The Moving Tablet of the Eye: The Origins of Mod- 
ern Eye Movement Research. Nicholas J. Wade and 
Benjamin W. Tatler. Oxford University Press, 2005. 

@ Vanishing Act. Art Wolfe and Barbara Sleeper. 
Bulfinch, 2005. 

@ Induced Visual Fading of Complex Images. 

D. Simons, A. Lleras, S. Martinez-Conde, D. Slichter, 
E. Caddigan and G. Nevarez in Journal of Vision, Vol. 6, 
No. 10, pages 1093-1101; September 26, 2006. 

@ Vision and Art: The Biology of Seeing. Margaret 
Livingstone. Abrams, 2008. 

@ Strange-Face-in-the-Mirror Illusion. G. B. Caputo in 
Perception, Vol. 39, No. 7, pages 1007-1008; 2010. 

@ Shifting Focus. Susana Martinez-Conde and Stephen 
L. Macknik in Scientific American Mind, Vol. 22, No. 5, 
pages 48-55; November/December 2011. 
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Yorick’s Ghost 
AND OTHER AFT ERIMAGES 


By Stephen L. Macknik and Susana Martinez-Conde 


Staring at images can temporarily reset retinal cells and cause ghostly visions 


Alas, Poor Yorick! I knew him, Horatio; a fellow of in- 
finite jest, of most excellent fancy; he hath borne me on 
his back a thousand times; and now, how abhorred in 
my afterimage he is! 


ell... that’s what William Shakespeare’s Hamlet 
might have said, had he been looking at a vintage 
Pears’ Soap advertisement bearing court jester Yor- 
ick’s skull, rather than holding an exhumed and 
rotting Danish cranium. Stare long enough at the skull in the ad, 
and it will be “burned” into your vision even after you look away. 


Afterimages such as Yorick’s skull help us understand how 
neurons in various areas of the brain adapt to the visual envi- 
ronment. Adaptation, in this case, is the process by which neu- 
rons habituate to, and eventually cease responding to, an un- 
changing stimulus. 

Once neurons have adapted, it takes a while for them to re- 
set to their previous, responsive state: it is during this period that 
we see illusory afterimages. We see such images every day: after 
briefly looking at the sun or at a bright lightbulb or after being 
momentarily blinded by a camera flash, we perceive a temporary 
dark spot in our field of vision. 


TO SEE OR NOTTO SEE... 


COURTESY OF LIVEWIRE PUZZLES www.puzzles.ca 
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YORICK’S SKULL. 


poccccccccccccccoccceceen 
An awe inspiring but interesting illusion. 
Pe 
“ Now get thee to my Lady's chamber, and tell her, let 
“ her paint an inch thick, to this favour she must come,” 
HAMLET. Act, V.—Scene x 
DAA 


DIRECTIONS TO SEE THE GHOST. 


Look steadily, in a good light, for thirty seconds at 
the mark X in the eye of the skull, and then at a sheet 
of paper, a wall, the ceiling or elsewhere, and continue 
your gaze fixedly for another thirty seconds when an awe 
inspiring and ghost-like skull will slowly appear ! 

By increasing the distance the apparition will 
increase in size, so that at five or six feet it will appear 
of huge proportions. 

Oooooooooocccccccoocooocollle 


PRESENTED BY PEARS’ SOAP. 


COURTESY OF G. SARCONE, © 2002 (top); COURTESY OF ROB JENKINS University of Glasgow 


AND RICHARD WISEMAN University of Hertfordshire (bottom) 


This illusion shows the interaction 
between color perception and afterim- 
ages. First, notice that the left image 
has a color imbalance to the right and 
left of the fly: the left side is bluish, 
and the right side has too much 
yellow. Now fixate your gaze on the fly 
in the right image for 30 seconds: this 
staring will make the neurons in your 
retina adapt to a blue hue on the left 
and yellow on the right. As a result, 
your left visual field will become less 
sensitive to blue and your right visual 
field less sensitive to yellow. 

Then look back at the fly on the cow’s 
nose, and the image will appear to 
have a perfect color balance. 

This illusion helps to explain why 
objects look the same color under 
different lighting conditions. For 
example, your shirt looks the same 
whether you are indoors or outdoors, 
even though light from a lamp 

and light from the sun have different 
color spectra. Your visual system 
adapts to the illumination and “dis- 
counts’ it to maintain color constan- 
cy. Some of this processing happens 
in the retina rather than the brain. 
Notice, too, that the color-selec- 

tive adaptation is constrained to a 
single eye: if you close one eye during 
the adaptation period and then switch 
eyes while looking at the cow, the 
color balance will revert to blue and 
yellow in the unadapted eye. 


In celebration of the 200th 
anniversary of Charles Darwin’s 
birth, psychologists Rob Jenkins 

of the University of Glasgow in 
Scotland and Richard Wiseman 
of the University of Hertfordshire 
in England created an illusory 
homage to Darwin’s evolutionary 
roots. Stare at the center of the 
image for 30 seconds, then look 
away at a white surface. The two 
monkeys turn into an afterimage 
of Darwin’s portrait! An after- 
image is never as sharp as the 
original. Jenkins and Wiseman 
took advantage of this difference 
in resolution to create an image 
that looks one way in “normal” 
high-resolution vision and 

a different way as a lower- 

resolution afterimage. 
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A BIRD OF A DIFFERENT FEATHER 

Positive afterimages can be captured from a complementary surrounding color, as in this demonstration of an 
uncolored bird that captures the reddish color of its background. Stare for about 30 seconds at the “target” on 
the bird in the left panel. Then look immediately at the same spot on the bird in the right panel. 

In this illusion, created by vision scientists Yuval Barkan and Hedva Spitzer of Tel Aviv University in Israel, the 
red background in the left panel causes the bird to fill in with a complementary blue-green color, which gives rise 
to a surprisingly strong and long-lasting red afterimage of the bird once the red background is removed. 

This illusion won second prize in the 2009 Best Illusion of the Year Contest. To experience an even more striking 
version of this illusion with a “flying” bird, visit http://illusionoftheyear.com/2009/color-dove-illusion 


RED AND YELLOW BEADS 

Gaze at the cross between the upper 

and lower squares for about 30 seconds. 

Then look immediately at the cross on the 
right, and you should see 18 colored beads: 
nine red beads above the cross and nine 
yellow beads below the cross. The beads are 
all gray in the image itself, but the surrounding 
colors induce colored afterimages. 


COURTESY OF YUVAL BARKAN AND HEDVA SPITZER Tel! Aviv University (top); 


COURTESY OF AKIYOSHI KITAOKA Ritsumeikan University (bottom) 
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“METAMERIC INTRANSITIVITY,” 


FROM “FILLING-IN AFTERIMAGE COLORS BETWEEN THE LINES,” BY R. VAN LIER, M. VERGEER AND S. ANSTIS, IN CURRENT BIOLOGY, VOL. 19, NO. 8; 2009. REPRINTED WITH PERMISSION FROM ELSEVIER (top); 
BY A. E. HUANG, A. J. HON, C. W. TYLER AND E. L. ALTSCHULER, IN ATTENTION, PERCEPTION & PSYCHOPHYSICS, VOL. 72, NO. 4; MAY 2010 (middle); COURTESY OF JOHN BORTNIAK NOAA (bottom) 


COURTESY OF ABIGAIL E. HUANG, ALICE J. HON AND ERIC L. ALTSCHULER Rutgers New Jersey Medical School and CHRISTOPHER W. TYLER Smith-Kettlewell Eye Research Institute; SOURCE: 


SHAPE-SPECIFIC AFTERIMAGES 
In this illusion a single colored image produces two afterimages of different 
colors, depending on the shapes you look at afterward. Fixate your gaze on the 


black dot between the colored stars in the middle panel and stare at it for 30 
A A seconds without moving your eyes. Then look at the empty outlines in the top 
_~ " Ww gf panel. The left one fills in with a ghostly blue-green, and the right one looks 
reddish. When you look at the bottom panel, the colors are reversed. 
<Q &> ° << > How does one image produce two afterimages of different colors? And how 
does the shape of the outline determine the filled-in color? The creators of this 
> a S Q illusion, Rob van Lier and Mark Vergeer, both then at Radboud University Nijme- 
Vv \ gen in the Netherlands, have suggested that patches of an afterimage can 
spread and merge to fill the contours of an outlined shape. The shape at the 


upper right takes on a reddish hue because it has the same outline as the com- 
plementary blue-green patches in the original color image. Likewise, the blue- 
green-tinged shape at the upper left matches the red patches in the color image. 
* This illusion won first prize in the 2008 Best Illusion of the Year Contest. 
See a dynamic version at http://illusionoftheyear.com/2008/ 
filling-in-the-afterimage-after-the-image 


NOTHING IS THE SAME 

These incredible illusions by Abigail E. Huang, Alice J. Hon and Eric L. 
Altschuler, all then at Rutgers New Jersey Medical School, and by Chris- 
topher W. Tyler of the Smith-Kettlewell Eye Research Institute show that 
objects of the same apparent color can look like different colors in an 
afterimage and that differently colored objects can appear to be the 
same color in an afterimage. Stare at the white spot between the yellow 
letters M and P in the upper image. Hold your gaze for 30 seconds and 
then look at a white wall. You will see an afterimage of the letters, 
which are now magenta (M) and purple (P). In the lower image there are 
two Y’s, one blue and one purple. Look at the white spot between them 
for 30 seconds and then move your eyes to a white wall. You will now 
see that the Y’s are the same shade of yellow in the afterimage. In fact, 
the M and P in the upper image are different colors that only look the 
same shade of yellow because of the effect of the red and black back- 
grounds. In the afterimage, the complementary background colors— 
blue-green and white—have the opposite effect: they make the M and 
P look more different than they really are. The Y’s are also different 
from each other, in the real image, but the complementary background 
colors in the afterimage make them look like the same color. 


LEAST COLORFUL 

PLACE ON EARTH 
Afterimage color assignment 
works very well with objects to 
which humans are exquisitely 
well tuned, such as faces. 
Gaze for 30 seconds at this 
reverse-color portrait of John 
Bortniak, who commanded 
the South Pole’s National 
Oceanic and Atmospheric 
Administration Corps (left), 
and then look at the image on 
the right to see it in color. 
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Colors 


OUT OF 
SPACE 


By Stephen L. Macknik and Susana Martinez-Conde 


Colors can change with their surroundings and spread beyond the lines 


It was just a colour out of space—a frightful messenger 
from unformed realms of infinity beyond all Nature as 
we know it; from realms whose mere existence stuns the 
brain and numbs us with the black extra-cosmic gulfs it 
throws open before our frenzied eyes. 


merican science-fiction author H. P. Lovecraft 
considered The Colour Out of Space to be his best 
story. In this 1927 classic tale of cosmic horror, 
a small Massachusetts farming community faces 
unspeakable evil from the outer reaches of the universe. The 
extraterrestrial villain is not a face-hugging or chest-bursting 


YELLOW MOON AND BLUE MOON 

Here we have two moons out of space. One yellow and one blue. 
Or are they? Actually both moons are exactly the same color in 
this illusion by psychologist Akiyoshi Kitaoka of Ritsumeikan 


alien but something far more terrifying: a weird color. 

Slowly but surely the otherworldly color mutates and de- 
stroys crops, insects, wild animals and livestock. It impregnates 
the land and the water. The unfortunate farmers who encoun- 
ter the bizarre hue fall prey to insanity and untimely death. 

And you thought vision research was for wimps. 

This article features some of the most spectacular color phe- 
nomena this side of the galaxy. You won’t see any extraterres- 
trials, but many strange illusions arise from taking colors out 
of place and putting them in an unusual context. Use caution: 
the peculiar shades and tints you are about to experience could 
blow your mind. 


University in Japan; only the surrounding colors are different. 
If you don’t believe it, cut out the two moons—you'll find them to 
be identical. The appearance of colors is all about their context. 


COURTESY OF AKIYOSHI KITAOKA Ritsumeikan University 
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COURTESY OF DALE PURVES Duke University (middle); COURTESY OF AKIYOSHI KITAOKA (bottom) 


SCIENTIFIC AMERICAN MIND, ADAPTED FROM WWW.MOILLUSIONS.COM (top); 


Sony 


Legend has it that Rome was founded by warring twin brothers, Romulus and Remus, born to a vestal virgin 
named Rhea Silvia and fathered by Mars, the god of war. Vestal virgins, as it turns out, are not supposed 

to conceive children, even if the father is a god. The family shame was too much for Rhea’s father, who killed 
her and then condemned the twin baby boys to die of exposure. The wolf Lupa found the boys and adopted 
them. But hey, what about Lupa’s biological pups, Rex and Fido, younger brothers to the feral Romans? 
These nonidentical twins (left) become identical when the background is removed (right). Had this pair been 
born before their mother discovered Romulus and Remus, surely Rome would have gone to the dogs. 
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PLLPLITIPES 


the images (above right) reveals that the blue squares on the left and 


Rubik’s Cube is a three-dimensional puzzle in which the player ro- the yellow squares on the right are actually all gray when viewed 
tates the tiled faces of a cube until each face shows the same color under white light. Color perception is not based strictly on the wave- 
on all nine tiles. Sounds easy? Only if the lighting conditions are lengths of the light that strikes your retina; instead the brain assigns 
stable. As these images by R. Beau Lotto of University College Lon- colors based on the lighting conditions and uses the wavelengths 
don and Dale Purves of Duke University show, if the lighting changes, only as a guideline to determine which objects are redder or bluer 

it can be hard to know which color is which. The masked version of than other objects in the same scene. 


It looks like this Japanese manga girl has one blue eye and one gray eye. In fact, both 
eyes are exactly the same shade of gray. The girl's right eye only looks the same as the 
turquoise hair clip because of the reddish context. Part of the process of seeing color is 
that three different kinds of photoreceptors in the eye are tuned to three overlapping 
families of color: red, green and blue (which are activated by visible light of long, medi- 
um and short wavelengths). These signals are then instantaneously compared with 
signals from nearby regions in the same scene. As the signals are passed along to 
higher and higher processing centers in the brain, they continue to be compared with 
larger and larger swaths of the surrounding scene. This “opponent process,” as scien- 
tists call it, means that color and brightness are always relative. 
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RED RINGS 

This image by Kitaoka contains 
a number of blue-green circular 
structures. The red rings are 
purely a creation of your brain. 

A process called color con- 
stancy makes an object look the 
same under different lighting 
conditions, even though the color 
of the light reflecting from the 
object is physically different. 
Color constancy is an incredibly 
important process that allows us 
to recognize objects, friends and 
family both in the firelight of 
the cave and in the bright sun 
of the savanna. 

Because the rings here are 
drawn in shades of blue, the 
brain mistakenly assumes that 
the image is illuminated by blue 
light and that the physically gray 
rings inside the blue structures 
must therefore be reddish. The 
visual system subtracts the blue 
“ambient lighting” from the gray 
rings, and gray minus blue 
results in a pastel red color. 


MULTICOLORED RINGS 

Here is another example of how the 
brain determines color depending on 
the context. In the bull’s-eye structures 
in the left checkerboard, the center 
rings look either green or blue, but they 
are all the same color (turquoise). The 
center rings in the right checkerboard 
are all the same shade of yellow. Unlike 
the previous images, this type of color 
illusion is difficult to explain by an 
opponent process because the appar- 
ent color of the rings is more similar 
than dissimilar to the background. 


FICKLE HEARTS 

All the hearts in this checkerboard 
are made out of the same cyan- 
colored dots, but they look green 
against the green background and 
blue against the blue background. 
The image, by Kitaoka, is based on 
the dungeon illusion discovered by 
vision scientist Paola Bressan of the 
University of Padua in Italy. 


COURTESY OF AKIYOSHI KITAOKA 
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COURTESY OF DALE PURVES (top); COURTESY OF AKIYOSHI KITAOKA (middle and bottom) 
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We have seen that the same colors can look different from one another, 


depending on context. These images show that context can also make 
different colors look similar. Check out the red tiles on the top face of the left 
and right Rubik’s Cubes. They look more or less like the same color. If we 
mask the rest of the tiles with white (above right), you can see that the tiles 
on the left cube are actually orange and that the tiles on the right are purple. 


We see four differently colored squares on a gray back- 
ground, right? Wrong. The gray is actually a mixture of little 
blue and yellow pixels. Because the pixels are so small, they 
blend together and do not activate the opponent processes 
that would create contrast. This is how a color television 
creates different colors from just a few differently colored 
pixels (hold a magnifying glass to your TV and prove it to 
yourself). The turquoise and chartreuse squares are actually 
little green pixels mixing with either the blue background 
pixels (turquoise) or the yellow background pixels (char- 
treuse). Mixing red pixels with either the yellow or blue pixels 
in the background creates the orange and purple. 


. 


In 1979 Michael White, then at the 
Tasmanian College of Advanced 
Education, described an illusion that 
changed everything in visual sci- 
ence. The gray bars on the left look 
brighter than the gray bars on the 
right. In fact, all the gray bars are 
physically identical. Before White 
discovered this effect, all brightness 
illusions were thought to result from 
opponent processes—that is, a gray 
object should look dark when sur- 
rounded by light and light when 
surrounded by dark. But in this 
illusion the lighter-looking gray bars 
are surrounded by white stimuli, 
and the darker-looking gray bars 
are surrounded by black. The brain 
mechanisms underlying White’s 
effect remain unknown. 
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SPARKLING COLOR 

In Light of Sapphires, the blue dots appear to scintillate as you move your eyes around 
the image. But when you focus on one dot, the scintillation stops. The blue color 
appears more saturated for the dot in focus than for dots in the visual periphery. 

This effect is a colorful variant of the scintillating grid illusion discovered in 1994 

by Elke Lingelbach, then at the Institute for Optometry Aalen in Germany, and her 
colleagues Michael Schrauf, Bernd Lingelbach and Eugene Wist. 


Illusion of the Year 


x 


ILLUSION OF THE YEAR 

White's effect also affects the way colors look. The logo for the Best Illusion of the Year 
Contest is a combination of White’s effect (the vase appears to be different colors behind 
the two curtains) and the famous face-vase illusion (in which the “vase” is a trophy for 
the winner). See more color combinations at http://illusionoftheyear.com 


SU 


UNREAL SPIRALS 

These spirals, created by Kitaoka, are particular- 
ly strong examples of White’s effect as applied 
to color. The green and cream-colored spirals 
(bottom) are made from stripes that are physi- 
cally yellow. In the other two examples above, 
the stripes are physically red and cyan, rather 
than purple, orange, blue and green. 


Mw 


COURTESY OF AKIYOSHI KITAOKA (top /eft and top to bottom at right) 


COURTESY OF NEURAL CORRELATE SOCIETY (bottom left) 
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COURTESY OF AKIYOSHI KITAOKA (top left, middle right and bottom right); 
COURTESY OF BAINGIO PINNA University of Sassari (bottom left) 


NEON COLOR SPREADING 

The colors from the small crosses appear to 
spread onto the white expanse surrounding 
each intersection. The effect resembles the 
glare from a neon light. This illusion was 
reported in 1971 by Dario Varin of the Univer- 
sity of Milan in Italy and a few years later by 
Harrie van Tuijl, then at the University of 
Nijmegen in the Netherlands. Its neural 
causes are currently unknown. 


CHROMATIC PINCUSHION GRID 

Here the neon color spreading produces a 
rectilinear grid of north-south and east-west 
streets on the map—but only in the periphery 
of your vision. It is absent from whichever 
intersection you happen to be staring at. 


COLORED RAY 
In this neon 
color spread- 
ing illusion, the 
yellow spreads 
in a direction 
that is perpen- 
dicular to the 
black bars. 


WATERCOLOR EFFECT 

In this illusion by vision scientist Baingio Pinna of the 
University of Sassari in Italy, a thin, orange contour adja- 
cent to a darker purple contour casts an orange tint over 
long distances—as though a watery paint was filling in the 
gaps between the orange lines [see “Illusory Color and the 
Brain,” by John S. Werner, Baingio Pinna and Lothar Spill- 
mann; SCIENTIFIC AMERICAN, March 2007]. On the opposite 
side of the purple contour, the outlined areas look white. 
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SMOGGY INTERSPACES 

In this image by Pinna, the 
inner square appears to have 
purple smog around the 
dots, and the outer square 
appears to be filled with 
blue. The illusion is caused 
by the watercolor effect. 
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WAVE-LINE ILLUSION 

The watercolor effect inspired the wave-line 
illusion by Japanese vision scientist Seiyu 
Sohmiya. In this version by Kitaoka, the white 
background behind the pattern is tinged 

by the color of the waves. 


CHINESE RUG 

The red color behind the blue lines ap- 
pears to be magenta, whereas the same 
red color behind the yellow lines appears 
to be orange. This “color assimilation” 
illusion shows that colors can blend with 
one another in some situations, rather 
than contrasting with one another. 


COURTESY OF BAINGIO PINNA (top); COURTESY OF AKIYOSHI KITAOKA, FROM “A WAVE-LINE COLOUR ILLUSION,” 
BY SEIYU SOHMIYA, IN PERCEPTION, VOL. 36, No. 9; 2007 (middle); COURTESY OF AKIYOSHI KITAOKA (bottom) 
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TOWER OF BABEL, © 2013 THE M. C. ESCHER COMPANY-THE NETHERLANDS. ALL RIGHTS RESERVED. WWW.MCESCHER.COM (bottom) 


© 2013 ESTATE OF PABLO PICASSO/ARTISTS RIGHTS SOCIETY, NEW YORK, AND SCALA/ART RESOURCE, NY (top); M. C. ESCHER’S 


ESCHER’S COLOR TOWER 


Here Livingstone and her Harvard colleague David H. Hubel took an Escher woodblock, Tower of 
Babel (left), and colored the white spaces light blue (center). You still see the tower because the 


luminance relations remain intact. But when the black spaces are replaced by a green shade 
with the same luminance as the blue (previously white) spaces, the 3-D character of the image 
falls apart (right). Our visual system cannot perceive volume, form and distance with only color 
information available. Luminance information is also required. 


PICASSO’S BLUE PERIOD 
During his blue period, 
Pablo Picasso painted 
everything—including 
shadows and gradations of 
sunlight—in shades of blue 
(left). How do we recognize 
the people if they are all 
the wrong color? Margaret 
S. Livingstone of Harvard 
Medical School has shown 
that although Picasso used 
blue, he was careful to 
maintain the luminance 
relations—contrasts in 
lighting within the scene 
[see “Art, Illusion and the 
Visual System,” by Marga- 
ret S. Livingstone; SCIEN- 
TIFIC AMERICAN, January 
1988]. Those luminance 
relations, which we use to 
make sense of the image, 
are apparent in a grayscale 
version of the painting 
(right). This is why color- 
blind people see just fine in 
almost every way—some- 
times they do not even 
know they have a deficit. 
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PICASSO’S COLOR SPREADING 

This painting by Picasso shows that coloring within the lines is 
unnecessary. Our brain assigns the colors to the correct shapes even 
though the shapes are depicted minimally with sparsely drawn lines. 
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Pablo Picasso, Spanish, 1881-1973 

Mother and Child, 1922, Oil on canvas, 39-3/8 x 31-7/8 in (100 x 81 cm) 
The Baltimore Museum of Art: The Cone Collection, formed by 

Dr. Claribel Cone and Miss Etta Cone of Baltimore, Maryland 

BMA 1950.279 
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“STUDIES OF INTERFERENCE IN SERIAL VERBAL REACTIONS,” BY JOHN RIDLEY STROOP, IN JOURNAL OF EXPERIMENTAL PSYCHOLOGY, VOL. 18; 1935 (top); 


COURTESY OF AKIYOSHI KITAOKA (middle); FROM TESTS FOR COLOUR-BLINDNESS, BY SHINOBU ISHIHARA. HANDAYA, TOKYO, HONGO HARUKICHO, 1917 (bottom) 
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COLOR BLINDNESS TEST 

Japanese ophthalmologist Shinobu Ishihara developed 38 color plates, 
including the two above, to test patients for color blindness. Each plate 
is a circle filled with dots of different sizes and colors. People with the 
most common types of color blindness find it difficult or impossible to 
see the numbers hidden within the patterns shown here. 
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DISCOMBOBULATING COLOR 

Here is a great cognitive visual illusion that involves a conflict between 
the syntactic and symbolic processing systems in your brain. Look at 
the words one after the other without stopping or slowing, but instead 
of reading each word, just say its color out loud. It’s hard, isn’t it? 

You are experiencing the Stroop effect, named after psychologist John 
Ridley Stroop. Even if you try not to read the words, you cannot keep 
the content of the words from conflicting with their color. 
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THE McCOLLOUGH EFFECT 


Discovered by vision researcher Celeste McCollough, this illusion 
demonstrates that the interactions between color perception 
and form perception can be surprisingly long-lasting. The effect 
takes discipline, though, so suck it up before you try it, soldier! 
We can’t make you do it, of course, but it won’t work correctly 
unless you do, and we promise it will be worth the effort. 

Look at the black dot at the center of the vertical magenta- 
striped grating for one full minute. (One minute will seem like 
forever, but trust us on this.) Then fixate on the dot in the horizon- 
tal green grating for one minute. Then shift back to the vertical 
magenta grating and then back to the green, for one minute 
apiece. Repeat another cycle. Okay, now you're ready. After six 
minutes of alternating between the two gratings, look back and 
forth between the uncolored patched gratings below. You will see 
that the horizontal patches are tinged magenta and that the 
vertical patches are tinged green. 

This illusion shows that adaptation, the process by which 
neurons in the brain become less responsive to unchanging 
stimuli, can be simultaneously selective for both color and orien- 
tation of edges. That is, you have neurons that are attuned to 
both magenta and vertical orientations, and when you stared at 
the vertical magenta grating for minutes on end, that allowed the 
horizontal-detecting neurons that are sensitive to magenta to 
seem more responsive. So when you are presented with a hori- 
zontal white grating after the adaptation, it looks tinged with 
magenta. The same is true for the green adaptation, for the 
opposite orientations. 

McCollough’s illusion was the first to show that adaptation 
can last a long time. If you come back in an hour and look at the 
white gratings, you will still see an effect, albeit weaker. 
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By Stephen L. Macknik, Susana Martinez-Conde and Ellis C. Gayles 


Military aviators learn to second-guess their senses 


44 SCIENTIFIC AMERICAN 


THE LEANS 


GETTY IMAGES (opposite page); COURTESY OF LCDR BRIAN D. SWAN, USN (RET.) (this page) 


MAJOR PAUL “Goose” Gosden, U.S. 
Marine Corps, piloted his UH-1 Huey 
close air support helicopter across the 
Kuwait-Iraq border through the night’s 
oily blackness. His aircraft was first to 
cross into Iraqi airspace in the second 
Gulf War, in support of Cobra attack 
helicopters tasked to destroy observa- 
tion posts on Safwan Hill, near the in- 
famous Highway of Death. Their mis- 
sion was the opening salvo of Operation 
Iraqi Freedom, designed to kick in the 
door for the U.S. Army’s Third Infantry 
Division, which would follow in a 
ground assault from Kuwait into Iraq. 
The Iraqi forces, however, anticipated 
the aerial sortie and had begun to de- 
stroy oil fields, filling the night air with 
oil smoke and haze so thick that it blind- 
ed the marines. 

Military flight training ingrains 
night flying so deeply that pilots can do 
it practically in their sleep. Flying 
through an oil cloud at night, on the oth- 
er hand, definitely ups the pucker factor. 
“Saddam had exploded the oil rigs to fill 
the air with oil. I couldn’t see the Cobra 
in front of me or the stars or the moon. It 
was just black,” Gosden recalls. To give 
yourself an idea of this feeling, start a 
mission in the helicopter combat Xbox 
game Apache (which one of us, Mack- 
nik, diligently toiled over as “research” 
for this article). Fly very high over enemy 
territory, then turn off your television 
(but not the Xbox) and try to land your 


helicopter blind as the bad guys begin to 
shoot at you. Remember, to simulate the 
experience of Gosden and his crew, you 
have to commit to actually killing your- 
self if your simulated copter crashes; 
otherwise it’s just a game. 


Spatial D and the Leans 

Gosden is telling his hair-raising tale 
at the Aviation Survival Training Center 
at Marine Corps Air Station Miramar 
near San Diego during a course one of us 
(Gayles) teaches. This air station was the 
storied home of the U.S. Navy’s (“Top 
Gun”) Fighter Weapons School, featured 
in the 1986 Tom Cruise movie. 

Gosden—coincidentally “Goose” is 
the call sign of Cruise’s wingman in Top 
Gun—continues, “We all had ‘spatial D’ 
or were suffering from ‘the leans.’” Spa- 
tial D is short for spatial disorientation, a 
catchall term to describe the summed re- 
sult of the various perceptual illusions 
and degraded sensory perceptions that 
may occur ona mission. It is the total fail- 
ure of situational awareness and, shock- 
ingly, the most common cause of crashes 
in the navy, accounting for almost 80 
crashes between 1990 and 2008. 

Performance fails because pilots can 
no longer pay attention to what is hap- 
pening—everything is off-kilter. All 
they can do is scan the instruments con- 
tinually to give themselves as much fac- 
tual information about the aircraft as 
possible, to counteract the false infor- 


The leans, one of the most common vestibu- 
lar illusions, occurs when the inner ear organ 
responsible for balance, the semicircular 
canal (pink rings), fails to continue to detect 
movement during a lengthy turn. As the air- 
craft turns, at first the endolymph fluid in the 
canal lags behind the turn, bending a hair 
cell (green), which signals the movement to 
the brain (left). In a prolonged turn, however, 
the vestibular system no longer detects the 
inertial difference between the canals and 
their fluid and no longer transmits the turn- 
ing information to the brain (center). As the 
plane rolls out of the turn, the inertial differ- 
ence between the fluid and canal reemerges 
but causes the misperception of turning in 
the opposite direction. 


mation from deceitful bodily senses. 

The leans is not a colorful military 
term for gastrointestinal distress, al- 
though the two phenomena are, unsur- 
prisingly, often experienced together. 
Rather the leans is a type of somatogyral 
illusion you feel in flight when your ves- 
tibular system (the inner ear organ re- 
sponsible for balance and your sense of 
traveling through space) and your so- 
matosensory system (skin and other 
bodily positioning sensors) together fail 
to provide you with an accurate descrip- 
tion of where gravity indicates is down. 

The illusion happens when you come 
out of a tight acrobatic turn and the flu- 
id in your vestibular semicircular canals 
system continues to flow even though 
you are no longer turning. As a result, 
you may feel like you are flying straight 
when in fact you are in a turn, some- 
thing that investigators concluded hap- 
pened when John F. Kennedy, Jr.’s plane 
crashed at Martha’s Vineyard in 1999. 
Technically, the leans is the name of a 
solution to the problem: leaning your 
head until your instruments match your 
perception. Even so, most pilots use the 
term to relay the problem rather than 
the solution. 

To get an idea of how critical your 
vestibular system is to your vision, hold 
up one finger in front of you at arm’s 
length, then look at it as you rotate your 
head back and forth. Fine, no problem: 
your finger is nice and clear. Your vestib- 
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ular system tracked the turning of your head and gave your 
eyes the information to stay on target. Now hold your head still 
and move your finger back and forth while following it with 
your eyes. Now there is no vestibular input because your head 
is stationary, so your finger becomes blurry. Motion sickness 
arises from a mismatch between vision and vestibular percep- 
tion and is a major component of spatial D. 


lraqi Nightlife 


Gosden survived his mission by virtue of using his aircraft’s 


forward-looking infrared (FLIR) optical array, which gave him 


Back at the Miramar station, the architecture of the train- 
ing facility is vintage 1950s U.S. military, the lobby festooned 
with uniformed mannequins in ejection seats. The lecture hall 
decor is exactly what you would find on the Boat (navy lingo 
for an aircraft carrier): overengineered steel recliner-size seats 
bolted to the floor, padded generously with genuine Naugahyde 
coverings. Flight suits abound. 

“When naval aviation was young, we were crashing two 
planes a day,” Gayles observes, “mostly caused by inevitable 
equipment failures. Now we crash 20 planes a year or so, and 
every crash is a very big deal, covered by the press, and report- 


As important as visual input is for a pilot, eyes can lie. 
False “horizons” are everywhere. 


the ability, in tandem with skill and luck, to notice a line of in- 
frared lights marking a column of American light armored ve- 
hicles (LAVs) on the ground. He could not see the ground, but 
the LAVs gave him just enough 
information about the landscape 
to allow him to land “safely”— 
that is, behind enemy lines in the 
middle of the desert surrounded 
by a high-speed battle. 

“T knew that the ground be- 
hind those LAVs must be flat, 
meaning we could land there. We 
knew our position was behind 
enemy lines. But we didn’t care— 
we had completed our flying for 
the evening. The other pilot on 
my helicopter, Captain Rodney 
‘Dino’ Dean, was suffering from 
vertigo, which had the opposite 
result to what was happening to 
me [the leans]. It was a miracle 
we got down,” Gosden says. “Af- 
ter landing, we got our weapons and set up a perimeter around 
the aircraft. When the sun came up, we could see well enough 
to fly out.” 


Training to Survive 

Night-vision devices such as personal goggles or the FLIR 
viewing system that Gosden used can ameliorate spatial D 
at night, but their performance is highly dependent on illumi- 
nation, terrain contrast and particulates in the air. For in- 
stance, these devices offer little help during brownout condi- 
tions, where dust can severely degrade visibility. The main de- 
fense that pilots have against the dangerous misperceptions 
and illusions reviewed here is simply the awareness that they 
can happen. 


The fog—or dust—of war can have pilots fighting their own senses 
and reliant on instruments, which are also badly degraded 
by a brownout. 


ed throughout the military. Most crashes are no longer the 
result of maintenance or equipment failures. Those problems 
have been reduced to the point that the main issue is human 
error. Pilots sometimes fly 
perfectly good aircraft into 
the ground.” 

And why does that hap- 
pen among the most highly 
trained pilots in the world? 
The answer: every sensory 
and cognitive system is highly 
taxed when flying military 
aircraft. Visual illusions 
alone accounted for about 20 
crashes from 1990 to 2008, 
making the combined contri- 
bution of illusions of all types 
twice as high as the next big- 
gest crash cause: fatigue. 

This challenge is why 
Gosden and this group of avi- 
ators are here today, to re- 
ceive their once-every-four-years refresher in situational 
awareness, aviation physiology and crash-survival training. 
They are lectured, questioned and then dunked unceremoni- 
ously into a huge, cold saltwater pool inside a crash simulator 
while wearing a blindfold. It’s scary, and the only people hav- 
ing fun are the two of us (Martinez-Conde and Macknik) on 
the side of the pool looking in. 


Shifting Horizons 

As important as visual input is for a pilot, eyes can lie. For 
example, when flying above a cloud deck, there is a natural ten- 
dency to perceive any relatively straight line in the visual field 
as a horizon—which can lead to very undesirable results in a 
fast-moving aircraft. 


FROM “A DUAL-MODE SENSOR SOLUTION FOR SAFE HELICOPTER LANDING AND FLIGHT ASSISTANCE,” 
BY YAN CHRISTIAN VENOT AND PETER KIELHORN, IN MICROWAVE JOURNAL; JANUARY 17, 2008 
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COURTESY OF LCDR BRIAN D. SWAN, USN (RET.) (top); COURTESY OF LCDR BRIAN D. 


SWAN, USN (RET.), SOURCE: CDR FRED R. PATTERSON, USN (RET.) (bottom) 
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Pilots have a natural tendency to consider any straight line 
in the cloud deck as a false “horizon.” Unfortunately, the 
illusion that a cloud deck is the true horizon can overwhelm 
the senses, requiring pilots to concentrate on instruments; 
coastlines, ridge lines and even well-lighted highways can 
also cause this dangerous effect. 


False “horizons” are everywhere around you in the 
clouds. Your aircraft’s attitude may seem level, even if you 
are tilted and in a turn. Mountain ridges might lead you 
astray as well, and at night the combination of clouds, stars, 
mountains and lights on the ground can produce impossibly 
confusing percepts that lead the aircraft away from the safety 
of true straight and level flight. 

Don’t think that you are safe from your own perception, 
however, just because you are flying above water ona clear day. 
A fixed horizon can still put you in the drink. Consider what may 


Beaches make a particularly insidious false horizon illusion. 
Because they are in a fixed location, the pilot will tend to point 
the aircraft ever downward to maintain the horizon ahead. 


happen if you approach the beach from over the horizon. You 
may line up the beach in your sights and then keep it there in an- 
ticipation of going “feet dry” (flying from over sea to over land), 
but if you do so, you will never reach land: the beach is fixed, un- 
like a true horizon, and the only way to keep it stationary in your 
sight is to point your aircraft progressively downward. 
Choosing a fixed horizon in proximity to wires or cables 


Reality 


spot the wires until they are very close (because of mountain 
haze or the fog of war), your natural reaction may be to push the 
stick forward to dive under the wires. This is what happened to 
the U.S. Marine pilots of an EA-6B Prowler aircraft on a train- 
ing mission in 1998 near an active Italian ski resort in the Alps. 
The aircraft sliced through two wires, which held a cable car 
holding 20 skiers 370 feet above the ground. None survived. 

One might think that objective information from instru- 
ments is the logical solution to subjective sensory illusions. The 
proliferation of instrumentation is part of the problem, how- 
ever, because of mounting attentional demands on the pilots, 
which cause cognitive overload during combat and other 
stressful flight scenarios. This kind of mental distress is an im- 
portant contributor to spatial D. New avionics are designed 
with simplicity, not complexity, in mind, and pilots learn how 
to scan their instruments at just the right times, under condi- 
tions of simulated duress. Systematic instrument scanning de- 
mands discipline, which may be one of the first casualties of 
battle, but until we learn better ways to overcome insidious in- 
flight illusions, it is one of the main techniques that keep pilots 
and crews safe. 


We would like to thank LCDR Brian D. Swan, USN (Ret.), CDR Tyson 
Brunstetter, USN, and CDR Fred R. Patterson, USN (Ret.), for their ideas 
and contributions to this article. 


stretched across a valley is especially prob- 
lematic. As you approach the fixed horizon 
(such as where a valley floor and mountain 
wall meet), you slowly and unnoticeably 
nose down. As you descend, the approach- 
ing wires will appear to rise as if they will 
pass well above you, whereas in fact they 
remain well below the aircraft. If you don’t 


(Further Reading) 


@ Spatial Orientation in Flight. A. J. Parmet and W. R. Ercoline in Fundamentals of 
Aerospace Medicine. Fourth edition. Edited by Jeffrey R. Davis, Robert Johnson, 
Jan Stepanek and Jennifer A. Fogarty. Lippincott Williams & Wilkins, 2008. 

@ Let’s Keep You Flying. Capt. Nick Davenport, USMC, in The Navy and Marine Corps 
Aviation Safety Magazine, Vol. 55, No. 1, pages 3-5; January/February 2010. 
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Atraid 


OF 
SHADOWS 


By Stephen L. Macknik and Susana Martinez-Conde 


Spooky illusions trick and treat your brain 


What difference do it make if the thing you scared of 
is real or not? 
—Toni Morrison, Song of Solomon 


alloween celebrates illusion. Even if we manage to 
ignore flights of fancy the other 364 days of the 
year, come October 31 we set out to enjoy trickery 
and pretense. We disguise ourselves, we carve 
malevolent expressions in bland, innocuous pump- 
kins and we do our best to suspend our disbelief as we enter 
supposedly haunted houses. We become illusion creators as 


ALL IS VANITY 

All ls Vanity, an 1892 drawing 

by American illustrator C. Allan 
Gilbert (left), draws on the 16th- 
and 17th-century European vani- 
tas painting tradition, in which 
still-life objects symbolize the 
transient and meaningless nature 
of earthly pursuits. The woman 
admiring herself in the mirror 
does not realize that her bottles 
of perfume, her makeup table 
(also called a vanity), her elegant 
gown, even her own youth and 
beauty, are fleeting illusions. Only 
death, represented by the skull 
engulfing the scene, is perma- 
nent and real. Last Days of the 
Sun, by British sculptor James 
Hopkins (right), puts a contempo- 
rary spin on the vanitas concept. 
The seemingly casual arrange- 
ment of rock-star bling signifies 
the futility of ephemeral fame and 
riches. The skull emerging from 
the image provides the set of 
items with symbolic meaning. 


well as willing victims. We seek fake fear. But costumes for our 
masquerades are not the only deceptions that Halloween brings 
you. Any emotion you experience, whether it be fright or 
delight, is real only in your mind. Ina neural sense, all of us are 
afraid of “ghosts”; we all have irrational fears that are discon- 
nected from fact (bugs and small spaces are some of our own 
personal phobias). With its harmless thrills and scares, Hal- 
loween pushes gently on the limits of the reality that our brain 
constructs. And one thing about limits, as Michael Jordan said 
in his Basketball Hall of Fame induction speech in 2009, is that 
“like fears, [they] are often just an illusion.” 


Bf Tit | ae 


C. ALLAN GILBERT, 1892 (left); COURTESY OF JAMES HOPKINS (right); 


COURTESY OF RANDOM HOUSE (opposite page) 
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THE HALLOWEEN TRE 
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TRICK-OR-TREATERS 

In The Halloween Tree, a 1972 novel by the late American horror, science-fiction and fantasy writer Ray 
Bradbury, eight children go trick-or-treating. Can you find them in the book’s cover? In this ambiguous illusion, 
the costumed kids, their props and the tree in the background form the shape of a skull. Step back from 

the scene or squint your eyes if you have trouble seeing the skull. To identify the trick-or-treaters, get close 
again, paying attention to the details in the image. When your perception of an ambiguous image flips back 
and forth between two possible interpretations, so does the underlying neural activity in the areas of your 
brain that are responsible for your experience. 
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WHAT LURKS 

IN THE SHADOWS 

Gestalt psychologists 
famously asserted that the 
whole is different from the 
sum of its parts. British 
artists Tim Noble and Sue 
Webster’s Dark Stuff 
agglutinates the bodies of 
189 mummified animals, 
including 67 field mice, 
five adult rats, 42 juvenile 
rats, 44 garden shrews, a 
fox, a squirrel, a weasel, 
13 carrion crows, seven 
jackdaws, a blackbird, a 
sparrow, a robin, a toad, 

a gecko and three garden 
snail shells. As anybody 
would agree, the outcome 
is so much more than the 
sum of its body parts. 


THE CURSE OF THE MUMMY 

“Wretchedness and death will befall to those who 
disturb the rest of the Kings!” Before you dismiss the 
Curse of the Twin Pharaohs as nonsense, take a 
careful look at the two sarcophagi and see if you can 
detect any signs of evil sorcery. The left sarcophagus 
appears longer and narrower than the one on the right, 
and the left mummy image is taller and skinnier than 
that of the other mummy. Or is this the case? Grab a 
pair of scissors and cut around the trapezoid shapes 
on top of each sarcophagus. Now rotate them and 
superimpose them. Both mummies and sarcophagi are 
exactly the same size. The effect is a variant of the 
classic Shepard tabletop illusion, in which two 
identical parallelograms with orthogonal orientations 
to each other appear dissimilar in shape. Images 
drawn inside the parallelograms, such as the 
mummies in the sarcophagi, are assimilated into the 
Shepard illusion, so that they, too, appear distorted. 


COURTESY OF TIM NOBLE, SUE WEBSTER AND BLAIN SOUTHERN (top); 


COURTESY OF DANIEL PICON (bottom) 
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COURTESY OF VILLAFANE STUDIOS 


American sculptor Ray 
Villafane competed as 

one of four professional 
pumpkin carvers and 
bagged the Grand Prize 

in the Food Network’s 
Challenge show, Out- 
rageous Pumpkins, in 

2008 and in Outrageous 
Pumpkins Challenge 2 in 
2010. He has since carved 
pumpkins around the world, 
including in the president’s 
White House quarters. 

For Halloween 2011 he 
established a new world 
record for carving the 
heaviest pumpkin ever 
documented. The beast, 
grown by Jim Bryson and his 
daughter Kelsey, weighed in 
at 1,818.5 pounds. Villa- 
fane sculpted zombies from 
a smaller pumpkin (weigh- 
ing a mere 1,693 pounds) 
and staged them to create 
the illusion of the living 
dead bursting out of the 
colossal squash pod. 

See the artist in action 
at www.visualnews. 
com/2011/10/29/ 
halloween-worlds-largest- 
pumpkin-carving 


(Further Reading) 


@ Mind Sights: Original Visual Illusions, Ambiguities, and Other Anomalies, with a Commentary 
on the Play of Mind in Perception and Art. R. N. Shepard. W. H. Freeman, 1990. 
@ Ray Villafane’s Pumpkins. R. Villafane. Gibbs Smith, 2012. 
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NO BRAIN, 


By Stephen L. Macknik and Susana Martinez-Conde 


Pain is an emotion 


Dennis Rogers holds two planes > 
still as they attempt to fly away 
in osite directions. Do not try 


opposite 
this stunt at home! 
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We are more often frightened 
than hurt; and we suffer 
more from imagination than 
from reality. 

—Lucius Annaeus Seneca 


DENNIS ROGERS isan unassuming guy. 
He’s on the short side. And though mus- 
cular, he doesn’t come across as the kind 


Rather he has the kind of avuncular in- 
tensity you find ina great automobile me- 
chanic—a mechanic who happens to be 
able to lift an engine with one hand while 
using the fingertips of the other hand to 
wrench the spark plugs out. Like it’s 
nothing. Rogers, who has been known to 
keep two U.S. Air Force fighter planes 
from blasting away in opposite directions 


celebrates the interests of one of Scientific 
American’s greatest columnists, the late 
mathemagician Martin Gardner. We 
asked Rogers about the source of his in- 
credible powers after the show, and we 
were surprised to learn that he did not 
know. Bill Amonette of the University of 
Houston—Clear Lake found that Rogers 
could recruit an abnormally high number 


What if, instead of from superpowered muscles, his abilities 
arise because he can withstand more muscular pain? 


by holding them back with his bare 
hands, performed at the most recent 


of towering Venice Beach, muscle-bound 


Arnold that you might expect from some- 
one billed as the World’s Strongest Man. 


Gathering 4 Gardner—a conference that 


of muscle fibers. But was this ability be- 
cause of a freak genetic mutation? Anoth- 
er possibility, which Rogers thinks is 


PAIN IS RELATIVE 

Our colleague at the Barrow Neurological Institute, Arthur “Bud” Craig, is a pain neuro- 
scientist who discovered the neural mechanisms underlying the terrifying “thermal grill 
illusion,” in which no damage occurs, but it feels as if it does. Think of it as waterboarding 
wired directly into your pain system. The device consists of a grill in which every odd hori- 
zontal tube is cold (not painful but cold), and every even tube is hot (not painful but very 
warm). When a subject’s hand rests simultaneously on both sets of tubes (cold plus hot), 
excruciating pain results. This is an illusion; the hand is not damaged, and its actual 
temperature remains unchanged because the cold and hot tubes cancel out each other 
thermodynamically. The effect occurs in part because signals from the hand’s heat-burn 
sensors interfere with those from the cold-freeze sensors, creating an imbalanced and painful 
sensation of burning cold within the brain. But by themselves, the cold and heat are not 
painful, so the subjective perception of hurt is simply incorrect: no damage, high pain. 

Craig has put forward the revolutionary proposal that your brain processes pain like an 
emotion. If you are tackled while playing the annual family football game before Thanksgiv- 
ing dinner, it can be fun. But the same tackle, out of the blue, while crossing the park on the 
way to your promotion review, can hurt like you-know-what: same damage, different pain. 


THIS IS GONNA HURT 

Henrik Ehrsson, then at the 
University College London 
Institute of Neurology, and his 
colleagues scanned the brains 
of subjects while threatening 
a fake hand that appeared 
attached to the participants. 
The anterior insula, a brain 
area that is critical to aware- 
ness of your body and, Craig 
argues, to all emotional 
awareness, lit up like crazy 

in brain imaging. The threat 
of damage, even to a fake 
appendage, causes brain 
activity that predicts pain. 
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When the turning of a dial gave an electric shock 
to a virtual character, observers experienced great stress. 


more likely, is the way he processes pain 
when he strains those muscles. 

What if, instead of superpowered 
muscles, Rogers has a normal—though 
extremely well exercised—body, and his 
abilities arise because he can withstand 
more pain than most mere mortals? He 
claims that he does feel pain and is 
actually scared of dentists. In fact, dur- 
ing one stunt in which he held back four 
souped-up Harley motorbikes with 
straps, he bit down so hard he split a 
tooth from top to bottom. Rather than 
taking his chances at the dentist, he 
reached into his mouth, clamped his 
viselike fingertips onto the broken tooth, 
and extracted it, root and all. 

Rogers reasons that, unlike in the 
dentist’s office—where he has no control 


over the pain that is inflicted on him—he 
has direct executive control over pain 
that he inflicts on himself. “I know it’s 
coming, I have an idea of what to expect 
and I can decide to ignore it,” he says. 
Confronted with severe pain, most peo- 
ple fear that they will damage their body 
permanently if they persist, so they stop 
well before they are in real danger, Rog- 
ers explains. He does not stop and only 
rarely gets seriously hurt. 

Maybe Rogers’s muscle cells are nor- 
mal, and he experiences pain as most of 
us do but chooses to disregard it when he 
feels in command. If so, he has become 
strong not because he was born ona plan- 
et with a red sun like Superman or was 
trained in the Danger Room of Charles 
Xavier’s School for Gifted Youngsters 


Brothers Elliot and Michael motivated their sister, Gertie, in the 
movie E.T. the Extra-Terrestrial by twisting her doll’s arm behind 
its back until Gertie submitted. Why did she care? Two research 
groups have explored this question recently, both with computer- 
generated characters and with toy robots. Mel Slater and his 
colleagues at University College London had subjects turn a dial 
at the command of an authority figure. The turning of the dial gave 
an electric shock to a virtual character, who appeared to react in 
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like an X-Man but because, when he has 
a job to do, he doesn’t care that it hurts. 
An illusion is a perception that does 
not match the physical reality. Is pain, 
then, as with illusions, a mind construct 
that some people can decide to turn off? 
As you will see in the studies that follow, 
pain varies as a function of mood, atten- 
tiveness and circumstances, lending sup- 
port to the theory that pain is an emotion. 
These studies show that empathy also ex- 
tends to pain, just as it does to other emo- 
tions, even when the victims are fake 
strangers. The research also indicates that 
people can experience pain for the wrong 
reasons or fail to experience it when it 
would be very reasonable to do so. More- 
over, when pain is disconnected from the 
physical reality, it is an illusion, too. 


pain. The experimental subjects experienced great stress from 


inflicting this fictional pain. 

Astrid Rosenthal-von der Putten and her group at the 
University of Duisburg-Essen in Germany scanned people’s brains 
as they watched movies of toy robot dinosaurs being mistreated 
by a human actor. Scientists found significant activity in the 
limbic areas of the brain, which presumably underlie the feeling 
of empathy. The same areas lit up even more when research 
subjects watched movies of humans being abused. 


Rogers has had his fair share of close scrapes. Here is the aftermath of a stunt in which a strap holding 
four straining motorcycles slipped and took the strongman’s epidermal layer with it. Rogers was 
immediately aware of the damage but shrugged it off as too minor to worry about until after the show. 


Severe burn victims must have their 
healing skin pulled and prodded daily 
to keep it from shrinking like plastic 
wrap, thus maximizing their mobility. 
Hunter Hoffman, David Patterson and 
Sam Sharar of the University of 
Washington developed a virtual-reality 
game called Snow World, in which 
patients in burn units who are under- 
going such painful treatments are 
distracted as they shoot Frosty and his 
penguin minions with a snowball BB 
gun. Virtual immersion in the frozen 
environment reportedly works better 
than morphine at counteracting the 
pain: massive damage, low pain. 


(Further Reading) 


@ How Do You Feel? Interoception: The Sense of the Physiological Condition of the Body. A. D. Craig in Nature Reviews Neuroscience, 
Vol. 3, pages 655-666; August 2002. 

@ Threatening a Rubber Hand That You Feel Is Yours Elicits a Cortical Anxiety Response. H. H. Ehrsson, K. Wiech, N. Weiskopf, 
R. J. Dolan and R. E. Passingham in Proceedings of the National Academy of Sciences USA, Vol. 104, No. 23, pages 9828-9833; 
June 5, 2003. 

@ A Virtual Reprise of the Stanley Milgram Obedience Experiments. M. Slater, A. Antley, A. Davison, D. Swapp, C. Guger, C. Barker, 
N. Pistrang and M. V. Sanchez-Vives in PLOS ONE, Vol. 1, No. 1, Article e39; December 20, 2006. 

@ Humans Show Empathy for Robots. Tanya Lewis in LiveScience; April 23, 2013. www.livescience.com/28947-humans-show- 
empathy-for-robots.html 


COURTESY OF DENNIS ROGERS (top); IMAGE COURTESY OF ARI HOLLANDER AND HOWARD ROSE; 


COPYRIGHT HUNTER HOFFMAN University of Washington www.vrpain.com (bottom) 
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GAZING AT EACH OTHER 


WHAT'S 
INA 


Face? 


By Susana Martinez-Conde and Stephen L. Macknik 


The human brain is good at identifying faces, but illusions can fool our “face sense” 


ur brains are exquisitely tuned to perceive, recog- 
nize and remember faces. We can easily find 
a friend’s face among dozens or hundreds of unfa- 
miliar faces in a busy street. We look at one 
another’s facial expressions for signs of appre- 
ciation and disapproval, love and contempt. And even after 
we have corresponded or spoken on the phone with somebody 
for a long time, we are often relieved when we are able to meet 


DR. ANGRY AND MR. CALM 
Vision scientists Aude Oliva of the Massachusetts Institute of 
Technology and Phillippe G. Schyns of the University of Glasgow in 
Scotland created this illusion by producing hybrids of two images. 
The left picture shows Dr. Angry, and the picture on the right is Mr. 
Calm. But if you step away from this page, you will see that 
appearances can be deceiving. Nice Mr. Calm becomes Dr. Angry, 
and nasty Dr. Angry turns out to be a pretty decent fellow after all. 
Fine details become blurred at a distance, leaving you with only the 


him or her in person and are able to put “a face to the name.” 
The neurons responsible for our refined “face sense” lie in 
a brain region called the fusiform gyrus. Trauma or lesions to 
this brain area result in a rare neurological condition called 
prosopagnosia, or face blindness. Prosopagnostics fail to iden- 
tify celebrities, close relatives and even themselves in the mir- 
ror. But even those of us with normal face-recognition skills 
are subject to many illusions and biases in face perception. 


—— 


overall shapes and shadings of the images: what vision scientists refer 
to as the low-spatial-frequency content of an image. When you move 
closer, the images are once again dominated by their fine details, 
which are referred to as high spatial frequencies. The illusion works 
because the face on the left is composed of a high-spatial-frequency 
angry face combined with a calm face in low spatial frequencies. The 
right face is exactly the opposite: a low-spatial-frequency angry face 
with a high-spatial-frequency calm face. When the images are blurred 
(by stepping away), the hidden layers of the hybrid are revealed. 


COURTESY OF AUDE OLIVA M.1I.T. AND PHILIPPE G. SCHYNS University of Glasgow 
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Mona Lisa’s captivating smile (left) is perhaps the most renowned 
art mystery of all time. Margaret S. Livingstone, a neurobiologist at 
Harvard Medical School, showed that Mona Lisa’s smile appears and 
= / disappears owing to different visual processes used by the brain to 
perceive information in the center versus the periphery of our vision. 

Look directly at Mona Lisa’s lips and notice that her smile is very 
subtle, virtually absent. Now look at her eyes or at the part in her hair, 
while paying attention to her mouth. Her smile is much wider. The 
movement of our eyes as we gaze around Mona Lisa’s face makes her 
smile come alive, flickering on and off as our perception of it changes. 

The center and periphery of the visual field have this differential 
effect on perception because the neurons at the center of our vision 
see a very small portion of the world, giving us high-resolution vision. 
Conversely, the neurons in the periphery see much larger pieces of the 
visual scene and thus have lower resolution. 

This is what happens in the eye while viewing Mona Lisa: the eye 
focuses light that is reflected from the painting onto the retina, upside 
down and backward (above). Adjacent photoreceptors within the retina 
are activated by adjacent points of light reflected from the painting. 


vision to the far periphery. The smile appears on the left and center 


MONA LISA (C. 1503-1506, OIL ON PANEL), BY LEONARDO DA VINCI (1452-1519)/LOUVRE, PARIS/GIRAUDON/THE BRIDGEMAN ART LIBRARY (top left); 


COURTESY OF BARROW NEUROLOGICAL INSTITUTE (top right); COURTESY OF MARGARET S. LIVINGSTONE Harvard Medical School (bottom) 


Mona Lisa’s smile can be explained by the fact that images are 
blurred in the periphery of our vision, so that her smile is only seen 
when blurred. Livingstone solved this mystery by simulating how the 
visual system sees Mona Lisa’s smile in the far periphery, the near 
periphery, and the center of our gaze (above, left to right). The simula- 
tion was done in Adobe Photoshop by simply blurring and deblurring 
the painting to simulate the change in resolution from the center of 


panels (far and near visual periphery) but is gone on the right panel 
(center of gaze). The effect is similar to the hybrid images of Dr. Angry 
and Mr. Calm and is likewise explained by the fact that different reti- 
nal neurons are tuned to different spatial frequencies. In a sense, 
Leonardo da Vinci painted the Mona Lisa as a hybrid, with a happy 
Mona Lisa superimposed on a sad one, each having different spatial- 
frequency content. 
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BY PETER THOMPSON, 


IN PERCEPTION, VOL. 9, NO. 4; 1980. REPRINTED WITH PERMISSION FROM PION LTD, LONDON (WWW.ENVPLAN.COM) (top); 


COURTESY OF PETER THOMPSON University of York, FROM “MARGARET THATCHER: NEW ILLUSION,” 
COURTESY OF STUART ANSTIS U.C.S.D. (bottom) 


MARGARET THATCHER ILLUSION 

This illusion by vision scientist Peter Thompson of the Universi- 
ty of York in England was critical to our understanding of face 
perception. When the illusion was discovered in 1980, scien- 
tists already knew that faces were difficult to recognize upside 
down. But the assumption was that because the brain always 
sees faces right side up, the face-recognition cells were opti- 
mized for right-side-up faces. This assumption was partially 
true, but the Margaret Thatcher illusion went further to show 
that the brain does not simply process and store representa- 
tions of whole faces; rather it recognizes representations of 
individual facial features such as the mouth and eyes. 

The top and bottom row of Thatcher images are identical to 
each other but flipped vertically. The top row looks like two 
upside-down Thatchers, no problem there. But the bottom row 
looks like a Thatcher on the left and a horrible mutant on the 
right. The reason is that whereas the left column depicts nor- 
mal faces (although the upper face is upside down), the right 
column shows Frankenstein-ish composites of Thatcher with 
only the eyes and mouths flipped vertically. The Thatcher at the 
upper right does not freak you out, because the eyes and mouth 
are right side up (although the overall face is upside down), and 
your face-perception neurons therefore see them as “normal” 
(even though they do not match the rest of the face). 

The bottom right image is creepy because the eyes and 
mouth are upside down and thus all wrong, despite the fact that 
the face as a whole is right side up. Research at Harvard by neu- 
roscientists Winrich Freiwald, Doris Tsao and Livingstone has 
found neurons in the brain that respond to specific face fea- 
tures such as mouths and eyes, confirming the predictions that 
were made from this illusion several decades earlier. 


TONY BLAIR ILLUSION 

Vision scientist Stuart Anstis of the 
University of California, San Diego, 
created this illusion in 2005 to 
celebrate the 25th anniversary of 
the Thatcher illusion. Anstis 
reasoned that if face-detecting 
neurons prefer right-side-up facial 
features, they should also be 
selective for other evolutionarily 
stable aspects of faces. He tested 
this idea by comparing positive and 
negative images of Tony Blair. 
Because we have evolved to see 
faces only in positive contrast, it 
follows that the perception of 
individual facial features should fail 
if shown in negative. As with the 
Thatcher illusion, showing the whole 
face in negative (top left) makes 

it less recognizable than the normal 
face (bottom left). Using positive 
images of the mouth and eyes 
overlaid on a negative face does not 
look particularly grotesque either 
(top right). But a positive image of 
Blair with a negative mouth and 
eyes (bottom right) is just as horrid 
as the upside-down mouth and eyes 
in the right-side-up Thatcher. 


Our nervous systems are hardwired to detect and process faces 
rapidly and efficiently, even with scarce details. Pictures such 
as the ones shown above are often referred to as Mooney faces, 
after cognitive psychologist Craig Mooney, who used similar 
images in his research on perception. Mooney faces illustrate 


how little visual information it actually takes to “see” a face. 

The artist who created the movie poster for Premonition 
understood this phenomenon (opposite page). The tree branch- 
es, leaves and birds in the poster form only the barest outline 
of actress Sandra Bullock’s face. Our brains fill in the gaps and 
construct a finished face from sparse visual content. 


AARON SCHURGER 
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TRI-STAR/THE KOBAL COLLECTION AT ART RESOURCE, NY 


PREMONITION 


IT’S NOT YOUR IMAGINATION 
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il IN THEATERS MARCH 2007 = sony.com/Premonition 
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GAZING AT EACH OTHER 


HOLLOW MASK ILLUSION 

This hollow mask created by sculptor Bryan Parkes gives the eerie 
impression that Albert Einstein’s face is following you as you move 
around the room (below). The mask is placed in front of a window, 
with its open back facing toward you, so that sunlight illuminates 
the plastic face. Although the mask is concave, your brain assumes 
that all faces are convex. While a convex face would look in only 
one direction, Einstein’s hollow face seems to look forward when 
the viewer is directly ahead, but at an angle when the viewer moves 
sideways. In another demonstration of this well-known illusion, 
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when a hollow mask rotates on a turntable, it appears to turn 
opposite to the actual direction of the turntable. 

Vision researcher Thomas Papathomas of Rutgers University created 
an interesting variation on this illusion by attaching three-dimensional 
eyeballs and a nose ring to a hollow mask. As shown in these three 
frames from a movie of the rotating mask, the eyeballs and nose ring 
appear to rotate in the opposite direction to that of the mask (above). 

This illusion won third prize in the 2008 Best Illusion of the Year 
Contest. You can view the movie at http://illusionoftheyear.com/ 
2008/rolling-eyes-on-a-hollow-mask 
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COURTESY OF DANIEL T. LEVIN Vanderbilt University (top); TSUNEO YAMASHITA Getty Images (bottom) 


Because our brains are so good at detecting faces, we sometimes see them where 
they do not exist. Were you ever scared as a child by strange faces popping up from 
an abstract wallpaper design or formed by shadows in the semidarkness of your 
bedroom? Ever noticed that cars seem to have faces, with the headlights as eyes 
and the grilles as mouths? These effects result from the face-recognition circuits 
of our brains, which are constantly trying to find a face in the crowd. 


While viewing composites of racially 
black (left) and white (right) faces 
that reflect exactly the same amount 
of light, two psychologists noticed 
an interesting illusion: the white face 
appears lighter. Daniel T. Levin of 
Vanderbilt University, working with 
Mahaarin R. Banaji of Harvard Uni- 
versity, proposed that the distortion 
occurs because abstract social ex- 
pectations about skin tone influence 
our perception of faces. 
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Visual illusions showcasing politicians are all the rage. At first sight it looks like Al Gore stand- 
ing behind Bill Clinton, but notice that Gore is really a doppelganger Clinton, only with Gore’s 
gorgeous head of hair (left). A set of face features (Clinton’s) mixed with a different set of 
features (Gore’s hair) isn’t easily recognized as being misplaced. 

Superman relies on the same illusion to protect his identity: thanks to a pair of glasses, 
a change of clothes and a different hairstyle, nobody in Metropolis realizes that he and Clark 
Kent are the same person (below). 


Gaze at the angry face (left) for about 30 seconds while looking around the face from the eyes to the mouth, 
to the nose, back to the eyes, and so on. Then look at the center face. It looks scared, right? Now look at 
the scared face (right) for 30 seconds and then look at the center face again. This time it is angry! In reality, 
the center face is a 50-50 blend of an angry and a scared face. 

Created by Andrea Butler and her colleagues at the University of British Columbia, this illusion shows 
that our visual-processing system adapts to an unchanging facial expression by temporarily becoming less 
responsive to it. As a result, the other facial expression dominates when you view the blend. This adaptation 
occurs in higher-level brain circuits, rather than in the retina, because the illusion works even if you view 
the left or right image with one eye only and then look at the center image with your other (unadapted) eye. 


COURTESY OF JASON BARTON University of British Columbia; FROM “FACTORS CONTRIBUTING TO THE ADAPTATION AFTEREFFECTS OF FACIAL EXPRESSION,” 
IN BRAIN RESEARCH, VOL. 1191; JANUARY 29, 2008. WITH PERMISSION FROM ELSEVIER (bottom) 


COURTESY OF PAWAN SINHA AND TOMASO POGGIO M.1I.T. (top); WARNER BROS./DC COMICS/THE KOBAL COLLECTION AT ART RESOURCE, NY (middle); 
BY A. BUTLER ETAL., 
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DAN KITWOOD Getty Images (top); PHOTOCOMPOSITION BY SMITHA ALAMPUR; THOMAS POLEN iStockphoto (bottom) 


Facial expressions play a key role in 
our everyday social interactions. Even 
when watching movies or looking at 
photographs, we spend most of our 
time looking at the faces they portray. 
Our intense focus on faces is at the 
expense of other potentially interesting 
information, however. Take a quick 
look at this woman and child. Their 
smiling faces suggest they are having 
a good time. But is that it? Look more 
closely, and you may notice that the 
girl has an extra finger on her right 
hand: something that you probably 
missed at first because your attention 
was fixed on the faces. 
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Peter Thompson, who discovered the 
Thatcher illusion, has now identified a 
new illusion that he calls the “fat face 
thin illusion.” In this example of the 
illusion, the photographs are identical, 
but the upside-down face appears 
strikingly slimmer than the right-side- 
up version. 

One possible explanation is that it 
is easier for the brain to recognize dis- 
tinctive facial features, such as chub- 
by cheeks, when they are viewed in 
the normal upright position. But that 
does not explain why thin faces don’t 
look fatter—or thinner still—when 
viewed upside down. 

This illusion competed as a top-10 
finalist in the 2010 Best Illusion of the 
Year Contest. 
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GAZING AT EACH OTHER 


THE 


eyes Have It 


By Susana Martinez-Conde and Stephen L. Macknik 


Eye gaze is critically important to social primates such as humans. 
Maybe that is why illusions involving eyes are so compelling 


negotiating relationships. Lovers stare for long stretches into 
each other’s eyes, and infants focus intently on the eyes of their 
parents. Even very young babies look at simple representations 
of faces for longer than they look at similar cartoonish faces in 
which the eyes and other features have been scrambled. 

In this article, we investigate a series of illusions that take 
advantage of the way the brain processes eyes and gaze. It turns 
out that it is fairly easy to trick us into thinking that someone 


he eyes are the window to the soul. That is why we ask 
people to look us in the eye and tell us the truth. Or 
why we get worried when someone gives us the evil 
eye or has a wandering eye. Our language is full of ex- 
pressions that refer to where people are looking—par- 
ticularly if they happen to be looking in our direction. 
As social primates, humans are keenly interested in deter- 
mining the direction of gaze of other humans. It is important for 


evaluating their intentions and critical for forming bonds and 


GHOSTLY GAZES 

Not knowing where a person is looking 
makes us uneasy. For this reason, it can be 
awkward to converse with somebody who 
is wearing dark sunglasses. And it is why 
someone might wear dark sunglasses to 
look “mysterious.” 

A recently identified visual illusion takes 
advantage of the unsettling effect of uncer- 
tainty in gaze direction. The “ghostly gaze” 
illusion, created by Rob Jenkins, now at the 
University of York in England, was awarded 
second prize in the 2008 Best Illusion of the 


Year Contest, held in Naples, Fla. In this illu- 
sion (left and center), twin sisters appear to 
look at each other when seen from afar. But 
as you approach them, you realize that the 
sisters are looking directly at you! 

The illusion is a hybrid image that com- 
bines two pictures of the same woman. The 
overlapping photos differ in two important 
ways: their spatial detail (fine or coarse) and 
their direction of gaze (sideways or straight 
ahead). The images that look toward each 
other contain only coarse features, whereas 
the ones that look straight ahead are made 


is looking somewhere else. 


up of sharp details. When you approach 
the pictures, you are able to see all the 
fine detail, and so the sisters seem to look 
straight ahead. But when you move away, 
the gross detail dominates, and the sisters 
appear to look into each other’s eyes. See 
an interactive demo at http://illusionofthe 
year.com/2008/ghostly-gaze 

In another example of a hybrid image 
(right), a ghostly face appears to look to 
the left when you hold the page at normal 
reading distance. Step back a few meters, 
however, and she will look to the right. 


COURTESY OF ROB JENKINS University of York 
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BY A. L. YARBUS. PLENUM PRESS, 1967. USED WITH PERMISSION 


FROM SPRINGER SCIENCE+BUSINESS MEDIA B.V. (top); COURTESY OF AUDE OLIVA M.I.T. (bottom) 


FROM “EYE MOVEMENT AND VISION,” 


About 50 years ago Russian psy- 
chologist Alfred L. Yarbus tracked the 
eye movements of volunteers as they 
viewed photographs of human faces 
and found that observers were pri- 
marily interested in the eyes shown 

in the portraits. But even though most 
of us pay close attention to the area of 
the face around the eyes, we are still 
forced to take lots of shortcuts when 
figuring out where someone is looking. 
These sensory shortcuts are what 
make us so vulnerable to visual 
illusions involving gaze. 


The ghostly gaze illusion is based on a hybrid-image technique created by Aude Oliva of the 
Massachusetts Institute of Technology and Philippe G. Schyns of the University of Glasgow in 
Scotland. In a shocking example of how perceptual interpretation of hybrid images varies with 
viewing distance, Albert Einstein, seen from up close, becomes Marilyn Monroe (left) or Harry Potter 
(right), when seen from a few meters away. For more hybrid images created by the Oliva laboratory, 
visit the hybrid-image gallery at http://cvcl.mit.edu/hybrid_gallery/gallery.html 
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SEEING DOUBLE? 

What if you duplicate some of the features of a portrait 
without overlapping them completely? It is relatively easy 
to create images in Photoshop in which the eyes and the 
mouth, but no other facial features, have been doubled. 
The results are little short of mind-bending: as the brain 
struggles (and fails) to fuse the doubled-up features, the 
photograph appears unstable and wobbly, and observers 
experience something akin to double vision. The neural 
mechanisms for this illusion may lie within our visual 
system’s specialized circuits for face perception. If you 
double up the eyes and mouth in a portrait, the neurons in 
the face-recognition areas of the brain may not be able to 
process this visual information correctly. Such failure 
could make the face unsteady and difficult to perceive. 


HERE’S LOOKIN’ AT YOU, KID 

Vision researcher Pawan Sinha of the Massachusetts 
Institute of Technology shows us with this illusion that our 
brain has specialized mechanisms for determining gaze 
direction. In the normal photograph of Humphrey Bogart 
(left), the actor appears to be looking to his left, but in the 
photo negative (right) he appears to be looking in the 
opposite direction. Yet Bogart’s face does not look back- 
ward; only the eyes are reversed. Why? The answer is that 
we have specialized modules in our brain that determine 
gaze direction by comparing the dark parts of the eyes 
(the irises and pupils) with the whites. When the face is 
negative, the whites and irises appear to swap position. 
Our knowledge that irises are light rather than dark ina 
negative does not change our perception of this illusion. 


HUMPHREY BOGART 
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COURTESY OF LIBRARY OF CONGRESS, PRINTS & PHOTOGRAPHS DIVISION (top); 


COURTESY OF AKIYOSHI KITAOKA Ritsumeikan University (bottom) 


1 Lonpon Opinion 1° 


FOLLOW MY FINGER 
The artists who drew these World War | recruiting posters knew 
something about eye tracking. No matter how you look at Uncle 
Sam (right) or British Field Marshal Lord Kitchener (left), the eyes 
and finger seem to be pointed directly at you. Today you can experi- 
ence the same phenomenon in an art museum, where the painted 
eyes in portraits sometimes seem to follow you around the room. 
Such eye tracking is not only a B-movie horror flick cliché but also 
a powerful illusion that continues to inspire visual science studies. In 
2004 vision psychologists Jan Koenderink, Andrea van Doorn and 
Astrid Kappers, all then at Utrecht University in the Netherlands, along 
with James Todd of Ohio State University, concluded that, contrary to 
popular belief, this compelling illusion does not require special artistic 


CONTEXTUAL CUES 

Contextual cues, such as the position 
of the face and the head, also 
influence the perceived direction of 
gaze. In this illusion created by 
Akiyoshi Kitaoka, a professor of 
psychology at Ritsumeikan 
University in Japan, the girl on the 
left appears to gaze directly at you, 
whereas the girl on the right appears 
to be looking to her left. In reality, the 
eyes of both girls are identical. This 
illusion was first described in 1824 
by British chemist and natural 
philosopher William Hyde Wollaston, 
who also discovered the elements 
palladium and rhodium. 


FOR U.S.ARMY 


NEAREST RECRUITING STATION 


abilities on the part of the painter. Surprisingly, all that is required is 
that the person portrayed looks straight ahead, and the observer's 
visual system takes care of the rest. 

The deceptively simple explanation is that when we look at 
a real human face or anything else in our three-dimensional 
physical world, the visual information that specifies near and far 
points changes with our viewing angle. But when we observe a 
two-dimensional painting or photograph hanging on the wall or 
a poster such as the ones above, the visual information that 
defines near and far points remains unaltered by our viewing 
angle. The brain interprets this information as if it pertained to 
a 3-D object, however. That interpretation is what creates the 
eerie sensation that a portrait’s eyes are following you. 
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GAZING AT EACH OTHER 


ANIMAL “EYES” 

A fascination with eyes is not 
solely a human trait. Many 
species of fish, insects and even 
birds sport false (one could say 
illusory) eyes on their wings, 
stalks or even the back of their 
head. These eye-catching 
patterns do not necessarily 
mimic real eyes, but they serve 
to dissuade, confuse or startle 
potential predators. Get an 
eyeful of these animals that 
sport eyespots (clockwise from 
upper left): an emperor moth 
with four false eyes, a northern 
pygmy owl with “eyes” in the 
back of its head, a butterfly fish 
with a fake eye that draws 
attention away from its head, 
an insect named the eyed click 
beetle, and a spicebush 
swallowtail caterpillar. 
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GAZING AT EACH OTHER 


THE 
ILLUSIONS 


Love 


By Stephen L. Macknik and Susana Martinez-Conde 


How do we fool thee? 


Let us count the ways that illusions play with our hearts and minds 


n Valentine’s Day, everywhere you look there are 
heart-shaped balloons, pink greeting cards and 
candy boxes filled with chocolate. But what is true 
love? Does it exist? Or is it simply a cognitive illu- 
sion, a trick of the mind? 

Contrary to the anatomy referenced in all our favorite love 
songs, love (as with every other emotion we feel) is not rooted 
in the heart but in the brain. (Unfortunately, Hallmark has no 
plans to mass-produce arrow-pierced chocolate brains in the 
near future.) By better understanding how the brain falls in 
love, we can learn about why the brain can get so obsessed with 
this powerful emotion. In fact, some scientists even see love as 
a kind of addiction. For instance, neuroscientist Thomas Insel 


THE SHADOW OF LOVE 

Many objects can cast heart-shaped shadows. 

For example, love can be seen through rose-colored 
glasses (left) or writ large (right). 
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and his colleagues at Emory University discovered that monog- 
amous pair bonding has its basis in the same brain reward cir- 
cuits that are responsible for addiction to drugs such as cocaine 
and heroin. Their study was conducted in the prairie vole, a 
small rodent that mates for life. But the conclusions are prob- 
ably true for humans, too, which may explain why it is so hard 
to break up a long-term romantic relationship. Losing someone 
you love is like going through withdrawal. 

In this article, we feature a number of visual illusions with 
a romantic motif. We hope that you and your special one will 
enjoy them. And remember, even if love is an illusion, that 


doesn’t mean it’s not meaningful and real (to our brain, 
anyway). 


DIMITRI VERVITSIOTIS Getty Images (left); GETTY IMAGES (right) 
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MELISSA THOMAS, ADAPTED FROM WWW.AMAZING-ILLUSION.COM (top); 


COURTESY OF G. SARCONE (bottom) 


ILLUSIONS THAT MOVE THE HEART 

Your wandering eyes pull at your lover’s heart- 
strings. In this illusion, the heart appears to 
move and even pulsate as you look around the 
picture. When your eyes move, they shift the 
retinal images of the black-and-white edges 

in the pattern, activating the motion-sensitive 
neurons in your visual cortex. This neural 
activation leads to the perception of illusory 
motion. Notice that if you focus your gaze ona 
single point, the illusory motion slows or stops. 


ILLUSORY NEON HEART 

The yellow fields inside the heart 
seem paler than the fields forming 
the contour of the heart, which 
appear to be a darker shade 

of yellow-orange. Right? Wrong. 
Actually all the yellow fields in the 
figure are identical. Any differences 
that you see are all in your mind. 
This effect is called neon color 
spreading because it resembles 
the effect of the light spreading 
from a neon lamp. The neural 
underpinnings of this effect are 
not yet understood. 
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GAZING AT EACH OTHER 


Ambiguity is affected by our frame of 
mind. In the image at the bottom left, 
Message of Love from the Dolphins, adult 
observers see two nude lovers embrac- 
ing, whereas young children see only 
dolphins. If you still can’t see the dolphins 
(we promise you they are there), look for 
more than two. In the image at the bot- 
tom right, a Valentine’s Day rose predicts 
the outcome of the evening’s festivities. 
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Here we see that love 
and amor are two sides 
of the same ambiguous 
object. This sculpture is 

an ambigram—an 
artwork or typographical 
design that can be read 
from two different 
viewpoints. Judith Bagai, 
former editor of The 
Enigma, the official 
journal of the National 
Puzzlers’ League, coined 
the term by contracting 
the words “ambiguous” 
and “anagram” (many 
ambigrams feature the 
same word seen from 
different directions). 


COURTESY OF SUSANA MARTINEZ-CONDE 


AND STEPHEN L. MACKNIK 
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IS LOVE AN ILLUSION? 

Spanish essayist Miguel de Unamuno said, “Love is the child of illusion and the parent of disillusion.” 

Is this view cynical or biologically based? Illusions are, by definition, mismatches between physical 
reality and perception. Love, as with all emotions, has no external physical reality: it may be driven by 
neural events, but it is nonetheless a purely subjective experience. So, too, is the wounded heart we have 
drawn here. Where the arrow enters and exits the heart, there is no heart whatsoever, only an imaginary 
edge defined by the arrow. 

This effect is called an illusory contour. We perceive the shape of the heart only because our brain 
imposes a shape on a very sparse field of data. Neuroscientist Riidiger von der Heydt and his colleagues, 
then at University Hospital Zurich in Switzerland, showed that illusory contours are processed in neurons 
within an area of the brain called V2, which is devoted to vision. The illusory heart even looks slightly 
whiter than the background, although it is actually the same shade. Much of our day-to-day experience is 
made up of analogous feats of filling in the blanks, as we take what we know about the world and use it 
to imagine what we do not know. 
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COURTESY OF AKIYOSHI KITAOKA Ritsumeikan University (top); SUAREE SUKPLANG Corbis (bottom) 


Nothing is more romantic than curling up in front of a fire with your 
loved one on Valentine’s Day as you lovingly whisper “chromostereop- 
sis.” Okay, maybe it’s not as passionate as a sonnet—unless you are 
a vision scientist. Look at the red and blue hearts and examine their 
depth with respect to the background. Most people find that the red 
heart pops in front of the blue background, whereas the blue heart 
sinks beneath the red background. 


This illusion comes about because the lenses in our eyes refract 
blue light more than red. This phenomenon is called chromatic aber- 
ration; another example of this effect is seeing a rainbow when you 
shine white light through a prism. When both eyes view the red and 
blue images simultaneously, the cornea and lens of the eyes refract 
different amounts of the colors. The brain deals with this sensory 
aberration by imagining depth even though all the elements in the 
images are in the same plane. 


Romance is not just for humans and prairie voles. 
Elephants also embrace the concept. 
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ART AND ILLUSION 


ART AS VISUAL RESEARCH: 


Kinetic Illusions 
IN OP ART 


By Susana Martinez-Conde and Stephen L. Macknik 


Art and neuroscience combine to create fascinating examples of illusory motion 


cientists did not invent the vast majority of visual 
illusions. Rather they are the products of artists 
who have used their insights into the workings of 
the human eyes and brain to create illusions in 
their artwork. Long before visual science existed 
as a formal discipline, artists had devised techniques to “trick” 
the brain into thinking that a flat canvas was three-dimension- 
al or that a series of brushstrokes ina still life was in fact a bowl 
of luscious fruit. Thus, the visual arts have sometimes pre- 
ceded the visual sciences in the discovery of funda- 
mental vision principles through the applica- 
tion of methodical—though perhaps more 
intuitive—research techniques. In this 
sense, art, illusions and visual science 
have always been implicitly linked. 

It was only with the birth of the 
op art (for “optical art”) movement 
that visual illusions became a rec- 
ognized art form. The movement 
arose simultaneously in Europe 
and the U.S. in the 1960s, and in 
1964 Time magazine coined the 
term “op art.” Op art works are ab- 
stract, and many consist only of black- 
and-white lines and patterns. Others use 
the interaction of contrasting colors to cre- 
ate a sense of depth or movement. 


This style became hugely popular after the Museum of 
Modern Art in New York City held an exhibition in 1965 called 
“The Responsive Eye.” In it, op artists explored many aspects 
of visual perception, such as the relations among geometric 
shapes, variations on “impossible” figures that could not occur 
in reality, and illusions involving brightness, color and shape 
perception. But “kinetic,” or motion, illusions drew particular 
interest. In these eye tricks, stationary patterns give rise to the 
powerful but subjective perception of (illusory) motion. 

This article includes several works of art in 


which objects that are perfectly still appear 
to move. Moreover, they demonstrate that 
research in the visual arts can result in 
important findings about the visual 
system. Victor Vasarely, the Hun- 
garian-French founder of the op 
art movement, once remarked, “In 
basic research, intellectual rigor 
and sentimental freedom neces- 
sarily alternate.” 
Op artists have created some of 
the illusions featured here; vision sci- 
entists honoring the op art tradition 
have created others. But all of them 
make it obvious that the link between 
aesthetics and illusory perception is an ar- 
tistic style in and of itself. 


MacKAY RAYS 
This illusion, created in 1957 by neuroscientist Donald M. 
MacKay, then at King’s College London, shows that simple 
patterns of regular or repetitive stimuli, such as radial lines 
(called MacKay rays) can induce the perception of shim- 
mering or illusory motion at right angles to those of the 
pattern. To see the illusion, look at the center of the circle 
and notice the peripheral shimmering. 


BY CHRISTOPHER W. TYLER, IN PLOS BIOLOGY, VOL. 3, NO. 4; APRIL 2005 


FROM “TRAVERSING THE HIGHWIRE FROM POP TO OPTICAL,” 
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© NICHOLAS WADE 


In a work reminiscent of British op artist 
Bridget Riley’s, vision scientist Nick Wade of 
the University of Dundee in Scotland created 

an example that features both streaming 

and shimmering motion. An eye is clearly 
visible in the center of the design, anda 
face becomes visible if you view the illusion 
from across the room or shake your head. 
The hidden face is a portrait of Wade’s wife, 
Christine, and the title Chrystine is a refer- 
ence to the chrysanthemum shape. 
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COURTESY OF PETER SEDGLEY (top); FROM JAPANESE OPTICAL AND 
GEOMETRICAL ART, BY HAJIME OUCHI. DOVER PUBLICATIONS, 1977 (bottom) 


British artist Peter Sedg- 
ley is an important figure 
in the op art world. His 
paintings explore the 
optical interaction of 
concentric colored cir- 
cles, which echo the 
geometry of the human 
eye and seem to pulsate 
on the black background. 
Sedgley airbrushed 
bands of color to create 
soft, overlapping rings in 
this 1968 work, YOU. 


OUCHI-SPILLMANN ILLUSION 

Move your head back and forth as you 

let your eyes wander around the image 
and see how the circle and its back- 
ground appear to shift independently of 
each other. Vision scientist Lothar Spill- 
mann, then at the University of Freiburg in 
Germany, stumbled on the illusion while 
browsing Japanese op artist Hajime 
Ouchi’s book Japanese Optical and Geo- 
metrical Art, which was first published 

in 1973. Spillmann then introduced the 
illusion to the vision sciences community, 
where it has enjoyed immense popularity. 
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An illusion developed by 
vision scientists Simone 
Gori and Kai Hamburger, 
then at the University of 
Freiburg in Germany, is a 
novel variation of both the 
Enigma effect and Riley’s 
Blaze. To best observe the 
illusion, move your head 
closer and then farther 
away from the page. As 
you approach the image, 
notice that the radial lines 
tilted to the right appear to 
rotate counterclockwise. 
As you move away from 
the image, they appear to 
rotate clockwise. This 
illusion was featured in the 
first edition of the Best 
Illusion of the Year Con- 
test, held in 2005 in Spain 
(see http://illusionofthe 
year.com/2005/rotating- 
tilted-line-illusion). 


This illusion is 

a contemporary 
variation on the 
Ouchi pattern, 
drawn by Kitaoka 
in 2001. 
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BY SIMONE GORI 


COURTESY OF AKIYOSHI KITAOKA (top); FROM “A NEW MOTION ILLUSION: THE ROTATING-TILTED-LINES ILLUSION,” 
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COURTESY OF MIWA MIWA (top); PARAMOUNT/THE KOBAL COLLECTION AT ART RESOURCE, NY (bottom) 


age to Vertigo, the classic 
1958 film by Alfred Hitch- 
cock (left). 


AES STEWART || Artist Miwa Miwa’s variant 
Kl | of the rotating-tilted-lines 
H cKS illusion (above) pays hom- 
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CHRISTMAS LIGHTS ILLUSION 

The Christmas lights illusion, by Italian artist 
and author Gianni A. Sarcone, is also based on 
Léviant’s Enigma. Notice the appearance of a 
flowing motion along the green-yellow stripes. 


TWO IN ONE 

Gori and Hamburger’s combination of the rotating- 
tilted-lines illusion and the Enigma illusion is 

both visually arresting and a powerful demonstra- 
tion of illusory motion from a static pattern. The 
Enigma illusion, some three decades after 

its creation by Léviant, continues to inspire 

visual science as well as visual arts. 
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This work by French artist José Ferreira W., Nerve Impulse, not only reprises the Enigma effect but also illustrates how nerve cells relay 
information from the eye to the brain: triggered by a flood of chemicals called neurotransmitters, nerve cells (at top) send electrical 


signals racing down slender structures called axons. At the axon’s knoblike terminals, each nerve cell releases its own neurotransmit- 


ters, which diffuse across a narrow synapse gap and bind with receptors on the branchlike dendrites of the next nerve cell to trigger 
a new electrical signal. Each successive neuron conveys the message to its neighbor, like a bucket brigade passing a pail of water. 
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ART AND ILLUSION 


SCULPTING THE IMPOSSIBLE: 


Solid Renaitions 


OF VISUAL ILLUSIONS 


By Stephen L. Macknik and Susana Martinez-Conde 


Artists find mind-bending ways to bring impossible figures into three-dimensional reality 


nan impossible figure, seemingly real objects—or parts of 
objects—form geometric relations that physically cannot 
happen. Dutch artist M. C. Escher, for instance, depicted 
reversible staircases and perpetually flowing streams. 
Mathematical physicist Roger Penrose drew his famously 
impossible triangle, and visual scientist Dejan Todorovié of the 
University of Belgrade in Serbia created a golden arch that won 
him third prize in the 2005 Best Illusion of the Year Contest. 
These effects challenge our hard-earned perception that the 
world around us follows certain, inviolable rules. They also re- 
veal that our brains construct the feeling of a global percept— 


PENROSE TRIANGLE 
The impossible triangle (also called the Penrose triangle or 
the tribar) was first created in 1934 by Oscar Reutersvard. 
Roger Penrose attended a lecture by M. C. Escher in 1954 
and was inspired to rediscover the impossible triangle. 
Penrose (who at the time was unfamiliar with the work of 
Reutersvard, Piranesi and other previous discoverers of the 
impossible triangle) drew the illusion 
in its now most familiar form (left) 
and published his observations 
in the British Journal of Psychol- 
ogy in 1958, in an article 
co-authored with his father, 
Lionel. In 1961 the Pen- 
roses sent a copy of the 
article to Escher, who 
incorporated the 
effect into Water- 
fall, one of his 
most famous 
lithographs 
(right). 
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an overall picture of a particular item—by sewing together mul- 
tiple local percepts. As long as the local relation between sur- 
faces and objects follows the rules of nature, our brain doesn’t 
seem to mind that the global percept is impossible. 

Several contemporary sculptors have taken up the challenge 
of creating impossible art. That is, they are interested in shap- 
ing real-world 3-D objects that nonetheless appear to be impos- 
sible. Unlike classic monuments—such as the Lincoln Memo- 
rial in Washington, D.C.—which can be perceived by either 
sight or touch, impossible sculptures can be interpreted (or mis- 
interpreted, as the case may be) only by the visual mind. 


SCIENTIFIC AMERICAN MIND (left); M. C. ESCHER'’S WATERFALL, © 2013 THE M. C. ESCHER 
COMPANY-THE NETHERLANDS. ALL RIGHTS RESERVED. WWW.MCESCHER.COM (right) 


COURTESY OF DEJAN TODOROVIC University of Belgrade (top); M. C. ESCHER’S BELVEDERE, © 2013 THE M. C. ESCHER COMPANY-THE NETHERLANDS. 


ALL RIGHTS RESERVED. WWW.MCESCHER.COM (bottom left); COURTESY OF MATHIEU HAMAEKERS (bottom right) 


Elusive Arch, by Dejan Todorovic, shows a new 
impossible figure. The left-hand part of the 
figure appears as three shiny oval tubes. The 
right-hand part looks corrugated, with three 
alternating pairs of shallow matte ridges and 
grooves. The bright streaks on the figure’s 
surface are seen either as highlights at the 
peaks and troughs of the tubes or as inflec- 
tions between grooves. Determining the 
direction of the apparent illumination falling 
on the figure is difficult: it depends on wheth- 
er we interpret the light as falling on a reced- 
ing or an expanding surface. Further, deter- 
mining the exact position and shape of 

the transition region near the center of the 
arch is maddening because the local 3-D 
interpretations defy the laws of illumination. 
For more about the arch, see http:// 
illusionoftheyear.com/2005/elusive-arch 
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Escher’s Belvedere (left) showcases columns that switch 
walls between their bases and capitals, a straight ladder 
whose base rests inside the building yet nonetheless 
enters the building from the outside at its top, anda 
sitting man holding an impossible cube. Mathieu 
Hamaekers, a Belgian mathematician and sculptor, 
created an homage to Belvedere that features a real-life 
impossible cube. This photograph (below) shows the 
artist holding the sculpture Upside Down, built in 1985. 
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IMPOSSIBLE BOX 

Hans Schepker has built outstanding sculptures of impossible 
objects, such as this Crazy Crate made from glass (left). Other 
views of the crazy crate show the method behind the madness 
(center and right). Notice that the illusion works only from a 


INDUSTRIAL-SIZE TRIANGLE 


specific vantage point. At any other angle, the illusion fails. Scientists 
refer to this as the accidental view, but there is nothing accidental 
about it. To perceive the illusion, the view must be carefully staged 
and choreographed, or else the audience will fail to see the “impos- 
sible” sculpture. 


BACKYARD MAGIC 
The late magician 
Jerry Andrus created 
this crazy crate, 
shown here from two 
different angles, in his 
backyard. The photo- 
graph on the right 
reveals the magic. 


Artist Brian McKay created a giant version of the impossible triangle (below, left) in Perth, Australia, in collaboration with 
architect Anmad Abas. How did they do that? A photograph taken from another angle (below, right) reveals the trick. 


COURTESY OF HANS SCHEPKER (top); COURTESY OF GEORGE ANDRUS (middle); 


COURTESY OF BJORN CHRISTIAN TORRISSEN bjornfree.com (bottom) 
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COURTESY OF MATHIEU HAMAEKERS (top); COURTESY OF FRANCIS TABARY (bottom) 


Unity, an impossible triangle created by Hamaekers in 1995, is now installed in 
Ophoven, Belgium. Again, the viewer’s location relative to the object is critical. But 
in this case, Hamaekers used a different physical method to achieve the illusion. 


Unlike most 3-D Penrose triangles, 
the sculptures by French artist 

and magician Francis Tabary are 
neither twisted nor open. They look 
impossible from a relatively large 
range of vantage points, although 
they do fail when seen from some 
viewpoints. The Tabary sculpture 
shown here is a four-cube-sided 
Penrose triangle. 
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Andrew Lipson, a self- 
described “professional 

nerd” with no official connec- 
tion to the Lego Group, and his 
friend Daniel Shiu have ren- 
dered five M. C. Escher works 
in Lego blocks, including this 
model of Escher’s Ascending 
and Descending (top). The 
original work by Escher, a 
1960 lithograph, shows a 
large building with an endless 
staircase on its roof (bottom 
right). Some of the people are 
ascending the staircase, while 
others are descending. 

Lipson and Shiu spent 
considerable time studying 
Escher’s work before begin- 
ning construction. In their 
photograph of the finished 
sculpture, it looks as if the 
staircase is continuous. But 
in this picture taken from 
another angle (bottom left), 
you can see that the edges 
of the staircase do not meet. 
The Lego illusion works only if 
the photograph is taken from 
exactly the right viewing angle. 


CONSTRUCTION BY ANDREW LIPSON AND DANIEL SHIU; PICTURES COURTESY OF A. LIPSON (top and bottom left); M. C. ESCHER’S ASCENDING 
AND DESCENDING, © 2013 THE M. C. ESCHER COMPANY-THE NETHERLANDS. ALL RIGHTS RESERVED. WWW.MCESCHER.COM (bottom right) 
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IT’S ALL RELATIVE The stairways are double-sided, and each stair is double-treaded. 
Lipson and Shiu also worked together on a Lego rendition of Escher’s A photograph taken from a slightly different angle and farther 
Relativity (top). The original version, a popular lithograph first printed away (bottom right) shows how the sculpture is made. Lipson and 
by Escher in 1953, depicts a surreal architectural structure in which Shiu used lots of scaffolding to hold it up. This was their fourth 
there seem to be three separate sources of gravity (bottom left). Escher picture rendered in Lego blocks. 


CONSTRUCTION BY ANDREW LIPSON AND DANIEL SHIU; PICTURES COURTESY OF A. 


RELATIVITY, © 2013 THE M. C. 
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ONE-MAN BAND 


Encore, by the late Japanese artist Shigeo Fukuda, uses similar principles 
to represent a pianist and violinist in the same sculpture when viewed 
from two vantage points. You can see only half of the duet at once, and 
neither is visible unless the sculpture is viewed from the side. 


MIRROR IMAGE 
Another work by Fukuda, Underground Piano, looks like a pile of piano parts 
unless you stand in the right place and view the “reassembled” piano in the mirror. 


SHADOW PLAY 
Fukuda welded togeth- 
er 848 forks, knives 
and spoons to make 
Lunch with a Helmet 
On. Here he cleverly 
resolves the illusion by 
placing a light at the 
critical vantage point, 
making the motorcycle 
obvious only in the 
shadow cast by 

the utensil pile. 


© SHIGEO FUKUDA, USED BY PERMISSION OF THE SHIGEO FUKUDA ESTATE 
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COURTESY OF P.S.1 CONTEMPORARY ART CENTER (top); 
COURTESY OF GUIDO MORETTI www. guidomoretti.it (bottom) 


IMELDA’S DREAM 

COME TRUE 

Imelda Marcos, widow of 
the former Philippines 
dictator Ferdinand Marcos, 
was infamous for her shoe 
collection but also for 
quotes such as this one: 
“People say I’m extravagant 
because | want to be sur- 
rounded by beauty. But 

tell me, who wants to be 
surrounded by garbage?” 
Well, Imelda, now you can 
be surrounded by both, 
courtesy of artists Tim 
Noble and Sue Webster, 
who create eye-catching 
artwork from rubbish. 

In 1998 Noble and 
Webster created this sculp- 
ture, Dirty White Trash (with 
Gulls), using six months’ 
worth of their own garbage. 
Like Fukuda, they used a 
strategically placed light 
source to cast their own 
shadows on the wall. The 
sculpture appeared ina 
2003 exhibition at the P.S.1 
Contemporary Art Center in 
Long Island City, N.Y. 


AND THE WINNERIS... 
For several years, Italian sculptor Guido Moretti has donated copies of his Three-Bar Cube and 


other impossible sculptures as trophies for the Best Illusion of the Year Contest. Depending on your 
vantage point, Three-Bar Cube can appear to be a cube, a solid structure or an impossible triangle. 


For more information, see http://illusionoftheyear.com/trophies 
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Truer 


THAN 
TRUTH 


By Susana Martinez-Conde and Stephen L. Macknik 


Trompe l’oeil illusions challenge your perception 


T always tell the truth. Even when I lie. 
—AI Pacino in 
Scarface, 1983 


IN THE STUDIO of sculptor Tom Eckert, life appears to im- 
itate art. A new snow shovel—Eckert cannot get much use 
of it in Tempe, Ariz.—hangs on the back wall, covered by a 
sheer piece of fabric. We had seen photographs of Eckert’s 
art before our visit, so we suspect that the translucent cur- 
tain is carved out of wood. But the trick is on us. Eckert 
reveals that the shovel is wood as well, as is the “plastic” 
hook holding it and the two not really galvanized metal 
nails securing the curtain to the wall. Instead a metal fas- 
tener hidden in the back supports the entire piece, and the 
shovel’s filmy silhouette is spray-painted onto the solid 
wood block that is the faux silk curtain. Elsewhere in the 
studio, we mistake wood sculptures for balled-up used 
work rags, and vice versa. Is the rag abandoned on the 
workbench a model for a sculpture, or are we looking at the 
carving instead? Only after touching it can we decide. 


SWIMMING POOL 

Argentine artist Leandro Erlich is the author of this permanent 
art installation at the 21st Century Museum of Contemporary 
Art, Kanazawa, in Japan. Observers from above enjoy the sight 
of undisturbed underwater breathers, while visitors meandering 
“inside” the pool experience blurry vision when they look up at 
the “surface” (a thin layer of glass covered by water). 


COURTESY OF LEANDRO ERLICH STUDIO 
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PHOTOGRAPH COURTESY OF TOMAS ROSENFELD 


MURAL BY DEREK BESANT; 


The Flatiron Mural is artist Derek Besant’s milestone outdoor public trompe I’oeil mural for the city 
of Toronto in Canada. The back end of the Gooderham Flatiron Building, a magnificent 1893 Victorian 
triangular structure with turrets and coned rooflines at the heart of Toronto’s Theatre District and 

St. Lawrence Market, was knocked down to create a park, and five windows were punched into the 
firewall facade, creating an aesthetic problem. “My solution was to apply aspects of the surrounding 
five blocks of architecture into a sculptural facade that appears to be a giant curtain,” Besant says. 
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TRUE LIES 

According to legend, trompe l’oeil (“to trick the eye” in French) originat- 
ed in a competition between artists Zeuxis and Parrhasius in ancient 
Greece. Zeuxis painted such lavishly appetizing grapes that birds tried 
to eat them. Sure of his victory, he attempted to unveil Parrhasius’ 
painting but was crushed to realize that the curtain he tried to pull 
aside was the art itself. Trompe I’oeil illusions work because your visual 
system uses position, shading and even the interplay of light on an ob- 
ject’s surface to build a mental representation of the world around you. 
Tom Eckert, a modern-day Parrhasius, does not consider himself a 
trompe l’oeil artist, however. “Trompe l’oeil implies mimicry,” Eckert 
says. “I create illusions.” Indeed, pieces such as The Raising of the 
Sphere appear to defy the laws of nature rather than emulate them. The 
“silk” cloth raising the ivory ball is not fabric but wood. The thinness, 
detail and luster of the carving deceive our visual neurons, and we con- 
clude that the material must lack the structural integrity to support a 
large, heavy object, despite what we see. The end result is not the per- 
ception of a masterful wood carving but of magic and the impossible. 


ATTACK OF THE GIANT ARACHNIDS 

One way to achieve spectacular trompe l'oeil illu- 
sions is through the use of anamorphic perspec- 
tive. Artist Marlin Peterson painted harvestmen 
(which, although they are arachnids, are not actu- 
al spiders) on a Seattle rooftop. The images are 
stretched so as to optimize 3-D perception for 
viewers at the observation level of the Space 
Needle; other vantage points diminish the illusion. 
As in many trompe I’oeil illu- 


sions accomplished by paint- ual | til S j 
ing, the expert use of shad- -_ . — BS) 
—— | 


ows is critical. Peterson 
needed six gallons of house 
paint and a full-body harness 
to create this artwork. 

You can see the major 
steps of the process ina 
short video at http://marlin 
peterson.com/2-minute- 
video-of-the-whole-mural 


CLONES AND MIRAGES 

As a young child in the backseat of the family car on a long hot Arizona highway, Eckert was 
struck by the persistent sight of water on the road. His parents told him it was a mirage, an 
illusion. He was stunned. The epiphany marked the beginning of a lifelong fascination with the 
boundaries of reality and our perception of it. Today Eckert is a producer of mirages. The shovel 
propped up against the wall is the real-world prototype of a hanging carved wood sculpture. 
Road mirages work because blue photons from the sky refract from the surface between cool 
and hot air just above the asphalt. Similarly, Eckert uses paint and carving techniques in such a 
way that light helps to evoke materials other than wood. Your brain sees luster and interprets it 
as the sheen of metal, for instance. Eckert’s shovel also exemplifies the perceptual principle 
known as amodal completion, by which we infer a whole object even if some of its parts are oc- 
cluded. Eckert did not need to carve a shovel handle, or even a full blade, to create the illusion 
of the complete tool. Just a touch of spray paint over the fabric “veiling” the implement, and our 
amodal completion mechanisms take care of the rest. 
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COURTESY OF PERE BORRELL DEL CASO (middle); RAY MASSEY (bottom) 


COURTESY OF CALVIN NICHOLLS/CALVINNICHOLLS.COM (top); 


Consummate trompe l’oeil artists make their creations jump out of the frame, 
sometimes literally, as in Spanish Catalan painter Pere Borrell del Caso’s Escap- 
ing Criticism (right). Paper sculptor Calvin Nicholls pulls off the illusion by creating 
actual 3-D objects from small pieces of paper (above left). He starts with a 2-D 
detail drawing, which becomes a pattern for all the paper pieces he will cut (above 
right). Then he traces individual pieces from the drawing and transfers them to the 
actual paper used in the sculpture, attaching them with minute amounts of glue. 


Painter Annie Ralli and photographer Ray Massey give new meaning to the term 
“handwriting.” If you have not seen the illusion yet, look again: There. Is. No. 
Pen. The illusion is part of a series for Ecclesiastical Insurance, a company 
using the tagline “You’re in good hands.” Notice how cleverly the pen’s “metal” 
clip disguises the index finger’s first knuckle. The perceptual principle known 
as good continuation (our perception that the paint lines defining the pen make 
up a single uninterrupted object) plays a big role in the deception. 


(Further Reading) 


@ Momento Mori: Contemporary Still Life by Tom 
Eckert, Robert Peterson and John Rise. Grady Harp. 
Lizardi/Harp Gallery, 2000. 

@ Sleights of Mind: What the Neuroscience of Magic 
Reveals about Our Everyday Deceptions. Stephen L. 
Macknik and Susana Martinez-Conde, with Sandra 
Blakeslee. Holt, 2010. 

@ Illusions of Reality: Naturalist Painting, Photography, 
Theatre and Cinema, 1875-1918. Gabriel P. Weisberg; 
contributions by Edwin Becker, Maartje de Haan, David 
Jackson and Willa Z. Silverman, with collaboration by 
Jean-Francois Rauzier. Mercatorfonds/Van Gogh Muse- 
um, Amsterdam/Ateneum Art Museum, Helsinki, 2011. 
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PERFECTLY TIMED 


Advertising 


By Stephen L. Macknik, Leandro Luigi Di Stasi and Susana Martinez-Conde 


Time is the most valuable thing 
aman can spend. 
—Theophrastus (371-287 B.c.) 


ANCIENT philosophers were far from 
alone in their musings about time. Play- 
wright Tennessee Williams wrote in 
1944 that time is the longest distance be- 


A seemingly every- 
day tableau of col- 
orful watches ar- 
rayed here are all 
set to a time of 
10:10. Why that 
time? Therein lies 
an intriguing men- 
tal mystery. 


Marketing illusions that make time fly 


tween two places. And the years since 
have proved him right. Fast travel, in- 
stant communications and express de- 
liveries between opposite ends of the 
world mean, more than ever, that time is 
not only relative but also an illusion. 
But time is also money—or so the 
axiom goes. Certainly both time and 


money are precious, exist in limited 
quantities and can be intimately inter- 
twined. Have you ever longed to get 
away but lacked the money or time to 
take your ideal vacation? In our travels 
we have noticed that airports, surpris- 
ingly, are a favorite location for high- 
end watch displays. It is as if travelers 


COURTESY OF SWATCH 
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GETTY IMAGES (top); SARUN LAOWONG iStockphoto (bottom) 


Both 10:10 and 8:20 have 

a visually arresting shape for 
the brain (bottom). But one is 
much more commonly used. 
Why is that? 


commonly must decide before imminent takeoff whether to 
pop into the newsstand to grab some gum and a copy of Scien- 
tific American or stop by the adjoining jewelry counter for a 
$10,000 Rolex. Who chooses the latter? We can’t, unfortu- 
nately, although we do like to window shop. Next time you do, 
pay special attention to the watch displays and see if you notice 
anything unusual. You may see how advertisers exploit the in- 
tersection of time and illusion to sell their products. 


Search for “watch images” on your favorite Internet brows- 
er, and you'll find something bizarre. Almost every watch is set 


What powertul insight, 


Not as cuckoo 
as you think: 
all clock sellers 
use the 10:10 
display (top). 


to 10:10. What belief, what powerful insight, what shared 
brain mechanism could cause salespeople to hock their clocks 
with that setting? Is it that shoppers preferentially like to make 
purchases just after morning tea? Or, as conspiracy theorists 
have suggested, because 10:10 is the hour when John F. Ken- 
nedy, Martin Luther King, Abraham Lincoln or John Lennon 
was assassinated? Or when Fat Man and Little Boy burned the 
sky above Nagasaki and Hiroshima? Nope. All such propos- 
als are factually incorrect. 

According to the New York Times, the Hamilton Watch 
Company was among the first to set its products to 10:10—in 
the 1920s. The previous standard setting was 8:20. Some ex- 


could 
cause salespeople to hock their clocks with that setting? 
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Time may fly like an arrow, but it is your attention 
to time that advertisers care about. 


ecutives now assume that the switch occurred to turn the 
watches’ 8:20 “frown” upside down, into a “smile.” 

But to visual neuroscientists like us, all this speculation begs 
the question as to why clock hands were set to oblique 
8:20/10:10 positions in the first place. It seems unlikely that pre- 
1920 watchmakers wanted their watches to frown. One possi- 
bility is that oblique watch-hand orientations are best at keep- 
ing company logos uncovered—but, if so, horizontal positions 
such as 9:15 or 2:45 would be even better. Because horizontal 
orientations have never been popular in watch advertisement, 
we can rule this idea out. 

Could it then be that oblique orientations result in higher 
watch sales than do cardinal—or vertical and horizontal—ori- 
entations? The answer may well be affirmative and possibly 
explained by the neuroscience of perception and cognition. Sci- 
entists have long known that we can detect cardinal orienta- 
tions more easily than oblique orientations. The visual cortex, 
moreover, responds to oblique orientations more weakly, as if 
they had lower contrast than cardinal orientations of the same 
physical brightness. In addition, fewer neurons are 
sensitive to oblique than to cardinal orientations. As 
a result, obliquely oriented watch hands are a tiny 
bit more difficult for us to see. 

At first, this fact may seem like bad news for 
marketing timepieces, especially if you think that 
watch hands should be as visible as possible in ads. 
But neuroscience suggests that watch hands that 
are somewhat harder to see could be a benefit to 
clock sellers. To maximize the potential for sales, 
you really want your customers to rivet their atten- 
tion on your product—and the visual challenge of 
seeing the oblique position draws that attention. 
Visual attention has the effect of enhancing the per- 
ception of difficult-to-detect image elements. In- 
deed, your attention is stronger when the object of 
interest is hard to see—such as watch hands that are 
oriented obliquely. 

If Mad Men (and Women) intuited that oblique- 
ly oriented lines are attention getters, people in oth- 
er fields may have arrived at similar conclusions. 
We looked for prominently featured clocks in fine 
art paintings and—voila!—Marc Chagall used the 
time 10:10 in his famous series of clock paintings 


The watch industry was not the first to use 10:10 
as an ideal setting for timepieces. Here is an 
example from artist Marc Chagall’s clock series. 


dating as far back as 1914, before the watch industry’s own 


10:10 preference. 


Time’s Arrow 

Watch manufacturers are not the only companies that have 
toyed with the interaction of time and illusion in commercial 
advertising. When you use FedEx courier services to buy your- 
self some time, you may overlook the clever illusion hidden in 
the company’s iconic logo: time’s arrow, pointing toward the 
future. You can see either the white arrow or the FedEx letters, 
but not both at once, because one is always the background 
to the other. 

The current FedEx logo was shortened from the earlier 
company name “Federal Express” and given a new snazzy il- 
lusory design element, the background arrow between the “E” 
and the “x.” Did the company shorten the name to reduce the 
amount of paint needed for signage on its planes and trucks? 
That explanation makes no sense, unless the painters could use 


only one font size. Once the name was shorter, they could just 


© 2013 ARTISTS RIGHTS SOCIETY, NEW YORK/ADAGP, PARIS AND BRIDGEMAN-GIRAUDON/ART RESOURCE, NY 
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paint the letters larger to take up the same space and use about 
the same amount of paint. In fact, according to Linden Leader, 
the graphic artist who designed the new logo, the FedEx CEO 
specifically requested that the logo be easily legible on every 
truck from five blocks away. 

Instead the change resulted from a thorough analysis of the 
company’s name recognition in the market. Why might the 
new logo be more effective? One reason is that the arrow, a 
symbol that has special meaning to our cognitive system, helps 
to draw attention to the logo as a whole. Arrows indicate what 
scientists call “implied motion.” Visual neuroscientists Anja 
Schlack and Thomas Albright of the Salk Institute for Biologi- 
cal Studies have shown that neurons that respond preferential- 
ly to specific directions of motion in the world are also activat- 
ed by arrows pointing in those directions even though the ar- 
rows are not themselves moving but just 


FedEx incorporates a forward-pointing arrow into its ambiguous logo 
(look at the white space in the type). In languages that read left to 
right, the arrow points right (upper left of image)—and the arrow 
points left in languages that read right to left, such as Arabic (truck). 


This same left-to-right effect works to express temporal or- 
der of pictograms grouped in sequences, such as in the famous 
representation of human evolution from prehominin to Homo 
sapiens. The direction of the sequence is fundamentally arbi- 
trary, yet if you grouped it the wrong way, it would look like a 
time reversal. 

So time may fly like an arrow, but it is your attention to 
time that advertisers care about. 


represent the concept of motion. 

The FedEx arrow pointing to the 
right signifies motion toward the future 
for those who write in English and other 
left-to-right languages. Moreover, be- 
cause motion-sensitive neurons also pre- 


(Further Reading) 


@ When Sustained Attention Impairs Perception. S. Ling and M. Carrasco in Nature Neuro- 
science, Vol. 9, No. 10, pages 1243-1245; October 2006. 

@ Unequal Representation of Cardinal vs. Oblique Orientations in the Middle Temporal 
Visual Area. X. Xu, C. E. Collins, |. Khaytin, J. H. Kaas and V. A. Casagrande in Proceedings 
of the National Academy of Sciences USA, Vol. 103, No. 46, pages 17,490-17,495; 


fer cardinal rather than oblique direc- 
tions, the arrow competes powerfully 
with the FedEx name itself, so our per- 
ception vacillates between “FedEx” and 
forward momentum. In languages read 
right to left, the FedEx arrow points to- 
ward the left, such as in the Arabic ver- 
sion of the logo, consistent with the cor- 
responding cognitive representation of 
time’s arrow. 


November 14, 2006. 

@ Remembering Visual Motion: Neural Correlates of Associative Plasticity and Motion 
Recall in Cortical Area MT. A. Schlack and T. D. Albright in Neuron, Vol. 53, No. 6, pages 
881-890; March 15, 2007. 

@ Arte e Espressione: Studi e Ricerche di Psicologia Dell’arte. Alberto Argenton. II Poli- 
grafo, Padua, 2008. 

@ Task Difficulty Modulates the Activity of Specific Neuronal Populations in Primary 
Visual Cortex. Y. Chen, S. Martinez-Conde, S. L. Macknik, Y. Bereshpolova, H. A. Swadlow 
and J.-M. Alonso in Nature Neuroscience, Vol. 11, No. 8, pages 974-982; August 2008. 

@ Why Time Stands Still for Watchmakers. Andrew Adam Newman in New York Times 
Media & Advertising section; November 27, 2008. 
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Food for Thought: 


VISUAL ILLUSIONS 


By Susana Martinez-Conde and Stephen L. Macknik 


Face or food? The brain recognizes edible artwork on multiple levels 


re you impressed with meals that look like one food 
but are actually made of something else? Tofu 
burgers and artificial crabmeat, for example, are 
not what they appear to be. 

It’s actually an old trick. In medieval times fish 
was cooked to imitate venison during Lent, and celebratory ban- 
quets included extravagant (and sometimes disturbing) delica- 
cies such as meatballs made to resemble oranges, trout prepared 
to look like peas and shellfish made into mock viscera. Recipe 
books from the Middle Ages and the Renaissance also describe 
roasted chickens that appeared to sing, peacocks redressed in 
their own feathers and made to breathe fire, and a dish aptly 


named Trojan hog, in which a whole roasted pig was stuffed 
with an assortment of smaller creatures such as birds and shell- 
fish, to the amusement and delight of cherished dinner guests. 

Unwelcome visitors were also treated to illusory food, but 
not for their own amusement. Instead they were served perfect- 
ly good meat that was made to look rotten and writhing with 
worms. Maybe not good enough to eat, but good enough to 
send your in-laws packing! 

Food illusions are alive and well in the 21st century. Our 
buffet of contemporary lip-smacking illusions will appeal to 
both your eyes and your stomach ... for the most part. We hope 
you'll enjoy the spread. Bon appétit! 


This still life by Italian painter Giuseppe 
Arcimboldo (left) includes the ingredients 
for his favorite minestrone soup and the 
bowl to serve it in. Turned upside down 
(right), Arcimboldo’s bowl of vegetables 
becomes a whimsical portrait of a 
man’s head, complete with bowler hat. 

There are several interesting aspects 
to this illusion. First, why do we see a face 
in the arrangement, when we know that 
it is just a bunch of vegetables? Our brain 
is hardwired to detect, recognize and 
discern facial features and expressions 
using only minimal data. This ability is 
critical to our interactions with other 
people and is the reason that we perceive 
personality and emotion in everything 
from crude masks to the front end of cars. 

Second, why do we see the face 
much more clearly when we flip the 
image vertically? The answer is that 
the same brain mechanisms that make 
face processing fast and effortless are 
optimized to process right-side-up 
faces, so upside-down faces are much 
harder to see and recognize. 


DE AGOSTINI PICTURE LIBRARY/G. DAGLI ORTI/THE BRIDGEMAN ART LIBRARY 


ITALY, CREMONA, VEGETABLES IN A BOWL OR THE GARDENER/ 
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ALOT TO DIGEST 
Arcimboldo’s composite heads demonstrate that, neuro- 
scientifically speaking, the whole can be much more than 
the sum of its parts. Clever arrangements of individual fruits, 
flowers, legumes and roots become exquisite portraiture in 
their entirety, such as in the likeness of the Hapsburg emperor 
_ Rudolf Il (top left), here depicted as Vertumnus, the Etruscan 
4 god of transformations, or in the artist’s self-portraits as 
Summer and Autumn (top right and bottom left). 
a The brain builds representations of objects from individual 
features, such as line segments and tiny patches of color. 
You see a nose in the Summer portrait not because there is 
a type of cell that perceives noses but because thousands of 
retinal photoreceptors in your eye react to the various shades 
of color and luminance in that area of the painting. High-level 
neuronal circuits then match that information to the brain’s 
iar stored template for noses. The output from those same photo- 
? receptors also activates the high-level object-tuned neurons 
that recognize turnips, figs and pickles, which is what makes 
4 images like these so much fun to look at. 


ERICH LESSING/ART RESOURCE,NY (top Jeft); SUMMER (1563, OIL ON CANVAS), BY GIUSEPPE ARCIMBOLDO (1527-1593)/ 
KUNSTHISTORISCHES MUSEUM, VIENNA, AUSTRIA/THE BRIDGEMAN ART LIBRARY (top right); AUTUMN, FROM A SERIES 


DEPICTING THE FOUR SEASONS, COMMISSIONED BY EMPEROR MAXIMILIAN II (1527-1576) (1573, OIL ON CANVAS), 
BY GIUSEPPE ARCIMBOLDO (1527-1593)/LOUVRE, PARIS/GIRAUDON/THE BRIDGEMAN ART LIBRARY (bottom) 
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Art can be more than just a feast for your eyes. The image above 
looks, at first sight, like a painting of a landscape. But look closer. 
These are actual photographs of foods laid out to resemble various 
types of scenery and terrain. London photographer Carl Warner 
(opposite page, top right) arranges meats and vegetables to create 
each environment as if from a Brothers Grimm fairy tale and then 
photographs the scene in layers from foreground to background. 
By using solely meats and breads in the image at the bottom 
right, for example, Warner captures the feel of old sepia postcards 
from the late 19th-century American prairie—complete with a 
breadstick-rail fence, serrano ham skies and a salami lane. Yum. 


Warner’s work is another example of how the brain puts 
together information from multiple streams. Visual data from 
every point of the image are converted from light to electro- 
chemical signals in the retina and then transmitted to the brain— 
where individual features are constructed from the information 
in the image. These discrete features are broadcast to multiple 
high-level visual circuits simultaneously: circuits that recognize 
faces, circuits that detect and characterize motion, circuits that 
recognize landscapes and places, and circuits that recognize 
and process food are just a few of the brain paths that receive 
this basic information. 
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CARL WARNER 


In Warner’s art, both the land- 
scape and the food-processing 
circuits are activated (the other 
circuits receive the information 
but ignore it as irrelevant because 
there are no faces, motion or oth- 
er triggers in the image). And 
voila! Our mind recognizes a deli- 
cious plate of cold cuts, as well 

as an overcast sky, in the same 
visual data. 
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Pointillist painters such as Georges Seurat and Paul Signac juxta- 
posed multiple individual points to create color blends that were 
very different from the colors in the original dots. But in a very real 
sense, all art is pointillism. In fact, all visual perception is pointil- 
lism. Our retina is a sheet of photoreceptors, each sampling a finite 
circular area of visual space. Every photoreceptor then connects to 
downstream neural circuits that build our perception of objects, 


Spanish artist Din Matamoro 
provides a unique perspective 
on developmental biology’s most 
fundamental question: Which 
came first, the chicken or the 
egg? In Matamoro’s fried eggs, 
ontogeny recapitulates phylogeny 
in an unusual and slightly unset- 
tling fashion: the shape of each 
fried egg resembles that of the 
chicken that the egg would have 
become or perhaps the hen that 
laid the egg in the first place. 
Such ambiguity illusions re- 
capitulate visual perception as a 
type of ontogeny in and of itself. 
Objects, in this case chickens, are 
built in the henhouses of our mind 
from nuggets of visual information 
sent from the retina. These little 
visual giblets activate circuits that 
process animal shapes (birds in 
this case) as well as circuits that 
process food data. This kind of 
multiple-channel processing is 
at the heart of all ambiguity: 
the neural basis of ambiguous 
perception is two or more brain 
circuits that compete for domi- 
nance in our awareness. 


faces, loved ones and everything else. Thus, vision itself is largely a 
pointillist illusion, colored by a tremendous amount of “guesstima- 
tion” and filling in on the part of our brain. It doesn’t matter whether 
the painter uses brushstrokes or fields of dots to define surfaces. 

The dots that compose these images of a cherry-topped cup- 
cake (left) and Laurel and Hardy (right) are made from multi- 
colored jelly beans, a technique that is not only clever but also 
delicious. Eat your heart out, Seurat. 


COURTESY OF DIN MATAMORO (top); COURTESY OF KRISTEN CUMINGS Jelly Belly Candy Company (bottom left); 


COURTESY OF PETER ROCHA Jelly Belly Candy Company (bottom right) 
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EMIKO AUMANN Getty Images (above, bottom right); COURTESY OF AKIKO & PIERRE Minimiam (bottom) 


NANCY J. KOCH Getty Images (top left); GETTY IMAGES (above, top right); 


ALL YOU CAN EAT 

The hypothalamus, a small brain structure that sits at 
the top of the brain stem in the limbic system, controls 
emotional responses via the autonomic nervous system, 
as well as food intake. So it is no wonder that, as the 
characters in Lionel Shriver’s novel 2007 The Post- 
Birthday World agree, everybody has strong feelings 
about food. Illusion artists using food as their medium 
have an unparalleled advantage to evoke emotions 
that enhance or destroy your appetite—unless you're 
a glutton for punishment, that is. 


Dramatist George Bernard Shaw said that there is no sincerer love 
than the love of food. If so, the miniature workers depicted here 
are living the dream. Of course, it’s all a matter of scale. 

The juxtaposition of Lilliputians and huge fruit has the dual illusory 
effect of making the potentially normal-size people look tiny and the 
possibly typical fruit look supersized. It happens because the human 
brain uses context, the relative dimensions of nearby objects in the 
world, as a primary means to determine their scale and absolute size. 


Think about it: we can’t simply use the size of the projection 
on our retina to determine the size of an object, because the size 
of the projection depends on how far away the object is. A small, 
nearby object can have a retinal projection of the same size as a 
larger object that is farther away. To compensate for distance, the 
brain compares the sizes of unknown objects with those of known 
objects that are in the same scene. Juxtaposing tiny people with 
enormous fruit plays havoc with that scaling system, and both 
categories of object are affected. 
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ART AND ILLUSION 


Peeling and paring can transform fruits and vegetables into a variety of amazing, 
strange and tasty illusions. Just in case your eyes are bigger than your stomach. 


WN ~~ 
\ wan 


S\ Wis . 
oe mit ANN Mss 


112 SCIENTIFIC AMERICAN 


